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EXECUTIVE SUMMARY 



The Developmental Therapy-Teaching Model: 

Outreach for Troubled Children and Teens through a Regional Trainers Network 

(CFDANo. 84.324R) 

October 1, 1999-September 30, 2002 
(no cost extension to December 30, 2002) 



This project. The Developmental Therapy-Teaching Model: Outreach for Troubled Children and 
Teens through a Regional Trainers Network, provided in-depth outreach to selected states, local 
agencies and individuals serving children and youth, K-12, with severe social, emotional, or 
behavioral disabilities (SEED) in inclusive, general educational, special educational, or community 
service agency settings. The project focused on individuals currently responsible for the day-to-day 
supervision of program services to these students and assisted these individuals to implement the 
Developmental Therapy-Teaching model within their own programs as well as to provide outreach 
to others within their regions. The original goals remained unchanged during the three years of the 
project. 



1 . Disseminate awareness materials about the needs of children with SEED, and how model 
practices can be used to meet these needs. 

2. Certify leadership individuals skilled in conducting supervisory/coordination activities to 
maintain program quality at sites where students with severe SEED receive services in 
acquiring greater social-emotional competence and responsible behavior. 

3. Increase the skills of direct service professionals in selecting, implementing, and 
demonstrating exemplary practices based on their increased understanding of the special 
program needs of these students. 

4. Establish a Trainers Network with certified Regional Associates independently providing 
model outreach with support from the project. 

5. Effective outreach project activities. 



Project Activities 

Project activities focused explicitly around the outreach mission: To assist leadership personnel and 
practitioners who face the difficult challenges presented by severe social-emotional-behavioral 
disabilities in effectively implementing proven practices of the Developmental Therapy-Teaching 
curriculum model. Outreach services included dissemination of information about emotional and 
behavioral disabilities and the ways the model addresses these needs (Task 1); Training Trainers 
as certified Regional Associates to independently assist others in model implementation (Task 2); 
Site Development for Model Replication to train direct service providers and parents for effectively 
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implementing the model practices (Task 3); Trainers Network for On-going Outreach to expand 
existing training, disseminate introductory information about the model and contract with new sites 
for training/model implementation (Task 4); and evaluation of project accomplishments in meeting 
needs of programs and individuals at each site. 

Over the three-year period, the project worked with 20 sites and 33 leadership individuals. 
Details of each task and its accomplishments are provided in the following sections. 

Project Outcomes 

At the end of the three-year period, the project exceeded anticipated outcomes for each task. 
Through dissemination activities, the project reached a documented total of 6, 175 individuals in 41 
states, and 12 foreign countries seeking information about the model and/or outreach assistance. 
Through 105 conferences and workshops, 2,194 individuals received inservice training. Twenty 
programs and agencies, 33 leadership personnel, 285 individuals serving 676 children with special 
needs, received in-depth, extended outreach assistance for model implementation during the three- 
year period. At the end of the project, 17 leadership participants had completed the Training 
Trainers certification requirements. Table 1 provides an overview of these project accomplishments. 

Project Effectiveness 

Project effectiveness was defined as (a) certified Regional Associates (RAs) with knowledge, skills 
and training materials, prepared to provide inservice training to others, (b) personnel with 
demonstrated proficiency in their own service setting for facilitating emotionally healthy 
development of children with severe social-emotional-behavioral problems, (c) increased social- 
emotional-behavioral competence of these children during staff training for model replication, (d) 
Regional Associates independently providing model outreach, and (e) outreach activities and 
services judged by recipients to be effective in meeting their needs. 

At the completion of the three project years, 17 leadership personnel successfully completed 
all requirements in the five competency areas and received certification as Regional Associates 
during the project, five continue to work toward certification. Observational ratings of actual 
performance of a representative sample of direct service providers, 62 teaching teams, at 17 
representative sites after initial model implementation, performance feedback, and tutorial 
assistance, indicated that 46 (74%) teams achieved DT/RITS proficiency scores of Adequate or 
better level by demonstrating basic practices necessary for model implementation. Of these, 33 
(53%) teams demonstrated Effective or Highly Effective skills. 

Measures of satisfaction of participants with their training experiences indicate that project 
activities met their needs, and most respondents indicated considerable gains in understanding and 
skills. Almost all participants also indicated a need for further training or more time with project 
instructors on-site. Workshop effectiveness, assessed by participants (including participating 
parents) received average ratings of 3.5 1 to 5.0 on a scale of 5 {Highly satisfied) to 1 {Not Satisfied), 
indicating a high degree of satisfaction. Similar results were indicated on workshop effectiveness 
with average ratings of 4. 18 to 4.96 when Regional Associates presented independently. Views of 
teaching team participants about their satisfaction and level of skill development through project 
experiences, assessed through anonymous questionnaires, item averages indicate levels of 
satisfaction from Satisfied (rating 3.59) to Highly Satisfied JydXmg 4.86). Views of leadership 
trainees about their satisfaction and the usefulness of their project activities was assessed through 
questionnaires, focus groups and teleconferences. High levels of satisfaction were indicated by the 
overall average rating of 4.56 on a scale of 5 {Highly satisfied) to 1 {Not Satisfied) for evaluation 
of the training experience. The participants voiced high opinions of their experiences both 



professionally and personally. 

Measures of social-emotional-behavioral development of a representative group of 279 
children at 1 1 sites during the model implementation period indicate that the group made statistically 
significant progress in all four curriculum areas-Behavior, Communication, Socialization, and (Pre) 
Academics-at the p<.000 level. These findings indicate that model implementation by the 
participating teams had a significantly positive effect in promoting increased social-emotional- 
behavioral development of the children that they served. Additionally inferential analyses for 
various groupings-severity of disabilities, type of disability, and program level-are also reported. 
When scores were analyzed for gender and race, the results indicated program effectiveness across 
these categories. 

A measure of overall effectiveness was obtained by interviewing local coordinators and 
Regional Associates to assess the extent to which participating programs acquired the basic elements 
for model replication. Of the 1 1 sites that participated in evaluation of child progress, all were rated 
at the Basic Implementation level or better, and five achieved the highest Model Demonstration 
level. Leadership individuals in the local programs who have successfully completed the RA trainers 
training can continue to provide staff support, train new personnel, and document program 
effectiveness. Additionally, through the Trainers Network, Regional Associates have received 
funding to provide training to foster parents, childcare providers, new employees in residential 
settings and public school personnel. 

Together, these evaluation results indicate that the overall project mission to improve service 
for children and youth with severe social-emotional-behavioral disabilities was achieved with 
distinct and measurable performance indicators. Project goals were effectively accomplished and 
exceeded anticipated outcomes in the original proposal. 



Table 1. Overview of Performance Indicators 
Final Performance Report, Oct. 1, 1999 - Dec. 30, 2002 



Management Objective 


States 

Reached 


Schools/Sites 

Served 


Individuals 

Reached 


Children 

Benefitting 

Directly 


Other Outcomes 


1. DISSEMINATION 


41 States 
12 Foreign 
Countries 


NA 


>6,175 

Individuals 


NA 


500 Web Contacts 
3,500 Newsletters 
1,300 Portfolios 
2,350 Stages Brochures 
2,675 Bookmarks 
1 ,200 Brochures 


2. TRAINING TRAINERS 
and 


7 States 


20 Schools & 
Agencies 


33 Leadership 
Trainees 


676 Children 


17 Leadership trainees; 
completed new 
certification program 
6 others in progress 


3. SITE DEVELOPMENT 
FOR MODEL 
REPLICATION 






285 Individuals 
with extended 
in-depth training 




18 Programs continuing 
with model components 
after training 












2,194 Workshop & 
Conference Participants 


3. DTT TRAINERS 
NETWORK FOR ON 
GOING OUTREACH 


Included in 
Categories 
2&3 


Included in 
Categories 
2&3 


120 Individuals 
through RA 
inservice & 
teaching 

(390 Participants 
included in 
workshops listed 
above) 


Included in 
Categories 
2&3 


State grant to 28 
childcare workers 
(WA) 

College Course content 
(NY) 

DTT Training as part of 
new employee 
orientation for 
statewide agency (KY) 


4. EVALUATION 


NA 


Model fidelity 
measured at 1 1 
replication sites 


Sample 
performance 
data analyzed 
for 62 direct 
service teaching 
teams (2+ 
people per team) 


Sample 

performance of 
279 children 
analyzed for 
social- 
emotional- 
behavioral gains 


Questionnaires, 
satisfaction survey 
from participants, focus 
group feedback, and 
teleconferences 
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FINAL PERFORMANCE REPORT 



The Developmental Therapy-Teaching Model: Outreach for 
Troubled Children and Teens through a Regional Trainers Network 

(CFDANo. 84.324R) 
October 1, 1999-September 30, 2002 
(no cost extension to December 30, 2002) 



INTRODUCTION 

The mission of this outreach project. The Developmental Therapy-Teaching Model: Outreach for 
Troubled Children and Teens through a Regional Trainers Network, was to assist educational and 
other agencies in implementing Developmental Therapy-Teaching, a proven educational model to 
improve services for children and youth, K-12, with severe social, emotional, or behavioral 
disabilities (SEED) in inclusive, general educational, special educational, or community service 
agency settings. T o achieve this, the proj ect focused on individuals currently responsible for the day- 
to-day supervision of program services to these students and assisted these individuals to implement 
the model within their own programs as well as to provide outreach to others within their regions. 
This assured the project’s intent of maintaining outreach assistance beyond the period of the project. 
In all settings, the program goal remained consistent: To foster improved social-emotional 
competence and responsible behavior of students through the successful integration of cognition, 
emotions, social understanding, and behavioral skills. 



THE INTERVENTION MODEL 

The Developmental Therapy-Teaching model provides a framework for guiding social-emotional 
development and responsible behavior in children and teens. It matches a child’s current social, 
emotional, and behavioral status with explicit goals, objectives, behavior management strategies, 
curriculum materials, activities, and evaluation procedures. It also defines roles for adults to 
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facilitate a child’s development. The model sequentially spans social, emotional, and behavioral 
development for children and youth from birth to 16 years. 

The curriculum has four areas.’ Behavior, Communication, Socialization, and (Pre) 
Academics/Cognition, to address four essential human activities — doing, saying, caring, and 
thinking. Within each of these four areas, specific teaching objectives follow developmental 
sequences for social-emotional competence and responsible behavior. Curriculum activities, 
management strategies, and adult roles define the ways the model is implemented for preschoolers, 
school-aged children, and teens. 

The Measurement Instruments 

Three measurement instruments provide the core evaluation measures. The Developmental 
Teaching Objectives Rating Form-Revised (DTORF-R) is a 171-item assessment instrument used 
to obtain a profile of a child’s social-emotional-behavioral status. It identifies the objectives for 
social-emotional competence in an Individualized Education Program (lEP), Individualized Family 
Service Plan (IFSP), or Individual Transition Plan (ITP). The rating process is used also for a 
functional behavioral assessment, provides a profile of current strengths as well as areas of 
difficulty, and is used at repeated intervals to evaluate child progress. 

The Developmental Therapy Rating Inventory of Teacher Skills (DTRITS) has four forms 
specifying the basic adaptations in practices for model implementation in four large age groups: 
infant/toddlers, preschool, elementary and middle/high school. The DTRITS includes an 
observational rating of an adult’s current performance skills, serves as a needs assessment for 
planning inservice training, is the basis for tutorial feedback, can be used as a self-guide for model 
implementation, and documents acquisition and maintenance of skills over time. DTRITS data also 
provide measures of replication fidelity at sites attempting model implementation. 



An Administrative Support Checklist contains 41 basic administrative elements associated 
with levels of program quality in model replication. Previous studies of model effectiveness have 
shown that certain minimal levels of administrative support were necessary for successful 
performance by direct service teams in classroom settings as measured by the DTRITS during a 
school year. 

The evaluation plan uses these three instruments to obtain measures of both qualitative and 
quantitative assessment of outreach activities and the optimal settings/conditions for achieving the 
greatest results. These measures of trainees, children, and programs were analyzed for evaluation 
of outcome effectiveness. 



A Proven Approach 

Effectiveness of this strength-based model has been validated three times for national replication 
by the Joint Dissemination Review Panel of the U.S. Office of Education, the National Institute of 
Education, and the Program Effectiveness Panel of the Office of Innovation and Development. The 
first validation documented model effectiveness for students with severe emotional disabilities; the 
second, as a personnel training model for direct service providers to these students. The most recent 
recognition was received in 1996 validating the use of the model in full inclusion, partial inclusion, 
and special education programs. In addition to validation as an effective educational model, the 
model was selected by the American Psychiatric Association in 1993 as one of five programs 
nationally to receive a Certificate of Significant Achievement in recognition of an innovative and 
well-researched program that applies the Developmental Therapy model in the treatment of 
emotionally disturbed children, resulting in outstanding clinical care and professional development. 

After twenty-five years of development, refinement, and replication, research clearly 
indicates the effectiveness of the model in meeting the needs of students with SEED. The approach 
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includes the following: 

1. Developmental Therapy-Teaching focuses on improving social-emotional competence 
and responsible behavior in students with severe social-emotional-behavioral disabilities. 

2. The model is used effectively in programs for children and youth from birth to 16 years. 

3. The model has been successfully applied in many settings: typical and inclusive programs 
in elementary and secondary schools, child care, preschools, kindergartens, children's homes. 
Head Start programs, specialized services in clinics, special education programs, residential 
schools, and mental health clinics. 

4. There is a philosophy and theory that professionals, paraprofessionals, volunteers, case 
workers, clinicians, and parents participating in co-training find easy to understand and 
implement. 

5. The curriculum is used in conjunction with other academic and social skills curricula, 
expanding options for simultaneously enhancing academic and personal development. 

6. The Developmental Teaching Objectives are used in the Individualized Educational Program 
(lEP)for social-emotional goals and for a Positive Behavioral Intervention Plan. 

7. There is a built-in quality monitoring and evaluation system with reliable and valid 
instruments to document student progress and personnel proficiency. 

8 . The model advocates multi-option educational placements, seeking environments best able 
to foster a student's social-emotional growth. 

HOW THE PROJECT GOALS WERE ACCOMPLISHED 

The Developmental Therapy-Teaching Programs is an outreach unit of the College of Family 

and Consumer Sciences at The University of Georgia, Athens, Georgia. The unit enjoys outstanding 

administrative support and working relationships with the Office of the Vice President for Services 



and Outreach, Dr. Arthur N. Dunning; and in the college with Dean Sharon Nickols. The unit is 
comfortably housed off-campus due to a critical space shortage at the University, but is able to 
cormect directly to all of the on-campus support systems. 

During this grant project time period, the unit received additional grant support for other 
outreach, training, and service activities from the Georgia Department of Education, U. S. 
Department of Education Office of Special Education Early Education Programs (CFDA 84.024C) 
and local public education and community service programs. 

Project staffing was consistent during the three grant years. National Instructors Dr. Faye 
Swindle, Dr. Susan Galis and Rosalie McKenzie served as part-time Senior Training Associates. 
Diane Wahlers served as Assistant Project Director. Lindy Carbone, as evaluator, coordinated data 
collection with project sites and data evaluation. The Coordinator for Dissemination, Betty DeLorme 
and Office Manager, Debbie Huth served part-time throughout the three grant years. In addition to 
this core staff, the project was able to obtain the services of three highly experienced Developmental 
Therapy National Instructors as adjunct staff/consultants to assist with in-depth training at selected 
field sites and national conferences. These were Dr. Bormie McCarty, Geri Williams, and Sara 
Williams, a specialist in services to children with Autism Spectrum Disorders. In addition. Dr. 
William Swan, Dr. Doug Flor and Lise Kalla provided consulting services for evaluation. 

The success of the project and subsequently its mission lay with the fit between goals and 
the agencies needs and commitments. Programs and agencies seeking to improve their services need 
all available information about resources and options. Keenly aware of this, the project had 
extensive communications with each potential site during plarming phases so that expectations of 
administrators and direct service providers were matched to the outreach assistance as nearly as 
possible. This overarching principle guided the activities, while keeping efforts directed to the 
objectives and outcomes as specified in the original proposal. 
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Improvements in Practice 

The major focus was improvement of practices for those who provide services on a daily basis to 
students with SEBD. The staff projected to accomplish this by concentrating on ways to assist 
service providers in actually implementing proven practices effectively. The extent of success in 
achieving these plans are reflected in the evaluation outcomes - both formative and summative. 

The project proposed three recipient groups for outreach services. The needs of field-based 
leadership individuals seeking training as trainers were a major project priority, addressed in Tasks 
2 and 4 - the Training Trainers Program and the Trainers Network for Ongoing Outreach. The 
second recipient group included direct service providers and parents at sites which sought to 
improve or expand services for students with SEBD in grades K-12. This group, addressed in Task 
3, Site Development for Model Replication, included teachers, administrators, support personnel and 
parents. Troubled children and teens, whose lEPs indicated a need for increased social-emotional 
competence and responsible behavior, were the third recipient group for services. Student progress 
in meeting lEP goals during outreach assistance was an essential standard used in the final 
evaluation of effectiveness. Activities and accomplishments are reported below, according to project 
management objectives. 



Services Provided 

Five specific tasks were accomplished. Task 1: Dissemination provided information about 
emotional and behavioral disabilities and the ways the model addresses these needs. It also 
supported other project activities for implementing the specified practices with practical material 
about how to adapt the model for each age group and individual student's needs. To effectively 
communicate with the large audience inquiring about the model, a strong dissemination segment was 
maintained and far exceeded the objective of providing 1500 concerned individuals with 



ERIC 



6 



14 



information. 



The overall dissemination goal - to make material about the model easily accessible and 
useful to recipient groups concerned with improving and expanding services to students with severe 
social-emotional-behavioral disorders (SEED) - was ongoing throughout the three project years. 
Information was distributed via four categories: electronic communications, print materials, 
instructional aids, and professional presentations. Over the project period, 500 individuals explored 
this model through our web site www.uga.edu/dttp and appropriate responses were made by email, 
telephone or shipped materials. Over 3,500 copies of our bi-annual newsletter, 
DEVELOPMENTIONS, were sent to 4 1 states and a dozen foreign countries. This publication served 
as a resource of up-to-date news, special features, international applications, training opportunities, 
conference summaries, and current model practices. Awareness portfolios introduced readers to a 
range of entry-level information about Developmental Therapy-Teaching model application and 
resources. Over 1,300 portfolios were distributed in the past three years in response to specific 
requests, at training seminars, and at national and international conferences. The Stages brochure, 
“A Guide for Helping Troubled and Troubling Children,” is included in each portfolio as well as 
shared singly at conference exhibits, in correspondence, or in person at meetings and networking 
sessions. Since the inception of this project, 2,350 Stages brochures have been distributed. Further, 
2,675 bookmark handouts announced the program and the web site at various conferences. A new 
basic brochure about Developmental Therapy-Teaching Programs was created in early 2002. Since 
that time, over 1,200 copies of the colorful, informational product have been disseminated. 

Instructional aids such as overhead transparencies, videos, Powerpoint presentations and 
audio case studies were distributed to certified Regional Associates (RAs) to enable each instructor 
to work effectively at sites to enhance positive, successful implementation by educators, 
administrators, parents, and other service providers. Developmental Therapy-Teaching Programs 
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staff, Regional Associates working toward completion of their certification and certified Regional 
Associates presented at 105 training workshops and conference sessions during the project period. 
Over 2, 1 94 participants received our materials at the events. These networking forums with national, 
regional, state, and local professional and parent groups further enhanced public interest and 
professional awareness as well as provided the opportunity for project RAs to strengthen their 
knowledge and skills. 

At the heart of the project activities were Task 2, Training Trainers, and Task 3, Site 
Development for Model Replication. These two tasks received the major portion of resources and 
staff time because activities involved extended, in-depth training with repeated visits to each 
participant at each site. Overall, during the three project years, activities to implement the model 
provided approximately 2,000 hours of direct, on-site or distance consultation and instruction 
through inservice, observations, seminars, workshops, presentations and tutorials at 20 program sites 
with 33 leadership personnel in the Training Trainers program and 285 direct service personnel 
working directly with 676 children with special needs.* The numbers participating exclude parents 
and additional local personnel who attended introductory workshops and staff debriefings, but were 
not in positions to participate for extended periods of in-depth training; e.g., parents, social workers, 
program directors/principles, psychologists, general education teachers. 

The purpose of Task 2 - to identify, design, and conduct outreach services to specifically 
meet the needs of individuals with leadership responsibilities for direct service had parallel and 
interacting activities which involved Task 3 - assisting local service delivery programs in 
implementing the model to expand and improve services to children and teens with severe social- 
emotional-behavioral disabilities (SEED). This entailed assisting direct service providers (teachers, 

*These numbers reflect the actual participants recorded at sites. Several sites opted out of the data pool; 
therefore, evaluation results are based on fewer participants and children. These are described in the Evaluation 



administrators, support personnel) and parents in acquiring the skills to select and implement 
exemplary practices shown to be effective. Thus, every program accepted for outreach assistance 
had one to four on-site leadership personnel participating in training to become certified 
Developmental Therapy-Teaching (DTT) Regional Associates. Appendix C, D, and F of the original 
proposal provide supportive material describing the basic elements needed for service delivery, 
criteria for site selections, criteria for leadership personnel acceptance, a sample training agreement, 
the model's "content map" for inservice training applications and a typical introductory site-training 
sequence. Planning at each site was unique to the identified needs of the RAs in training and the site 
direct service personnel. Prior to actual training, needs assessment activities were conducted and 
a training plan formalized. Each site differed in staff skills, needs, resources, and the students they 
served; therefore, as needed the implementation sequence was modified during the process. 

The experiences for the RAs in training were provided through an array of formats: 1) 
assigned readings and dialogue, 2) co-training with their project instructor through on-site classroom 
observations and feedback tutorials with local program personnel, 3) co-presenting with their project 
instructor at local, national, and international conferences, 4) independent training, 5) independent 
presentations, 6) satellite workshops, and 7) email and phone consultations. With program and RA 
needs varying greatly, each trainer-in-training (RA) progressed through individualized sequences 
until the competencies — knowledge and skills — required for certification were acquired. Regional 
Associates were prepared to (a) conduct awareness sessions and basic inservice training for 
implementation of DTT model practices proven effective, (b) guide their program staff through 
observation and specific feedback in gaining and maintaining high quality performance, and (c) 
assist new local programs in planning and implementing the DTT model. For cost effectiveness, 
technology was used whenever possible for mentoring and monitoring. E-mail, online discussion 
forums and computer-based conferencing provided inexpensive and accessible avenues for 



communication between the project and RAs in the field. 

Five performance standards and competencies were acquired by the RAs. These were 
assessed using Developmental Therapy-Teaching Programs performance standards: 

/ A knowledge base of developmental theory as it applies to social-emotional-behavioral 
development of children and youth from birth to age 16. 

/ Reliable use of the Developmental Teaching Objectives and Rating Form (DTORF -R) as an 

assessment instrument and ability to interpret the DTORF-R results for direct service 
personnel to assist them in planning and implementing their students’ therapeutic 
educational programs. 

/ Reliable use of the Developmental Therapy Rating Inventory of Teacher Skills (DTRITS) 
to assess the performance of direct service personnel as they work directly with students in 
each of four age groups: below age 2, between ages 2 and 6 years, between ages 6 and 9 
years, and ages 10 and above (Separate forms for Stages One - Four). 
y Proficiency in effectively supervising a team of direct service personnel, as rated by the 
practitioners, using rating procedures for supervisory standards. 

/ Proficiency in conveying Developmental Therapy-Teaching concepts to direct service 
personnel through seminars, lectures, workshops, and conference presentations, using an 
approved participant evaluation form. 

Additionally RAs were encouraged to develop proficiency to assist direct service personnel 
in establishing and using a system to document student progress annually, using the DTORF-R. 

Table 2 list the RAs accepted into the DTT Training Trainers project and their agencies, 
service delivery types and status of model implementation. 
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Table 2. Model Implementation/Regional Associate Training Sites 
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Year One 
= Year Two 
= Year Three 



Throughout the project period, 33 leadership personnel requested training for themselves and their 
sites. Once initiating services, 25 RAs and 1 8 sites remained active while, for reasons unrelated to 
the project, 8 RAs and two sites discontinued services. 

While there was variability in amount of project assistance provided to each program, on 
average a site received three project staff visits of three days each during a school year (18 contact 
hours per visit x 3 visits = 54 in-depth instructional hours approximately per program per year.) 
After an initial one to three day full staff introductory training, these visits generally consisted of 
a half-day to full day workshops, two or more classroom observations with feedback to the observed 
teams, and leadership seminars for the RAs. Table 3 contains summaries of the programs, the staff, 
and the number of children by age groups served by these 20 sites during the three year period. 

Task 4, the DTT Trainers Network for On-going Outreach, was initiated at the beginning 
of the second project year. Certified RAs implemented the final phase of the Outreach Project by: 
a) expanding existing training program at his/her site; b) fulfilling requirements for existing site to 
be certified as a model replication site\ c) disseminating introductory information about the model 
through presentations and inservice workshops or professional meetings; or d) contracting with a 
new site for training/model implementation. The RAs also worked with project instructors to 
evaluate, revise, and supplement existing training products and media packages for maximum 
effectiveness in meeting needs in that local program. Assistance from the project included 
informational portfolios, access to training videos, coaching in adult training techniques, 
review/critique of training plans and agendas for specific groups, review/critique video tapes of 
student groups and/or teachers, or distance leaming/conferencing opportunities. 

Thus, the Trainers Network serves as a project support system. This Network, comprised 
of National Instructors, Regional Associate Instructors and program administrators, is designed to 
sustain the independent efforts of its members by providing on-going consultation, process 



Table 3. Summaty Characteristics of the 20 Sites Receiving In-depth Staff Training 



Site 


# 

staff 

Trained 


Type of 
Service 


#of 

Children 

Served 


AGES 


2-5 

Pre-K 


6-11 

K-S'" 


12-14 
6"- - S'" 


Other 


023 


14 


Special Classes 
Partial Inclusion 


52 


2 


46 


4 




027 


10 


Full Inclusion 
Special Classes 


46* 










032 


4 


Special Classes 


8 




8 






035 


4 


Special Classes 


1 






1 




033 


na 


Special Classes 


na* 










024 


32 


Special Classes 
Partial Inclusion 


55 


2 


50 


2 


1 


036 


6 


Special Classes 


8 






5 


3 


005 


16 


Partial Inclusion 
Special Classes 


10* 










030 


na 


Full Inclusion 
Partial Inclusion 
Special Classes 


na* 










016 


34' 


Full Inclusion 
Special Classes 


52 


20 


28 


4 




028 


17 


Residential 
Special Classes 
Partial Inclusion 


32 




11 


8 


13 


018 


10 


Partial Inclusion 
Special Classes 


22 




11 


11 




003 


52 


Special Classes 


70 




1 




69 


002 


14 


Special Classes 


110 


107 






3 


014 


18 


Full Inclusion 
Partial Inclusion 
Special Classes 


31 


29 


1 




1 


007 


18 


Special Classes 


70 


36 






34 


001 


14 


Special Classes 


61* 










025 


4 


Partial Inclusion 
Special Classes 


22* 










029 


16 


Special Classes 


18* 










031 


2 


Partial Inclusion 
Special Classes 


8 




8 






TOTALS 


Total 

Served 


285 




676 










Data Pool 


225 




519 


196 


164 


35 


124 



* Not included in data pool. 




evaluation, and training resources (See Appendix A). The system has a mechanism for periodic re- 
evaluation of practices by these trainers and their training recipients to ensure effectiveness and 
fidelity to the specified model practices (See Appendix B for Minimum Requirements for a 
Regional Associate to Maintain Certification for Instruction in Developmental Therapy- 
Developmental Teaching.). The Trainers Network provided mentoring support from project staff to 
the RAs throughout the project period. The Network will continue via telecommunications, Internet 
web site, and e-mail activities. It is anticipated that these key groups of administrators and RA 
certified leadership individuals will continue to collaborate with Developmental Therapy-Teaching 
Programs via the Trainers Network for improved, coordinated services for students with SEED 
throughout their regions. 

The purpose of Task 5, Project Evaluation, was to evaluate project effectiveness in meeting 
the original project goals on time and within budget. Essential to the entire outreach design was an 
integrated system for assessing and monitoring performance skills and standards across all tasks. 
Accomplishments for each task were evaluated for timeliness and effectiveness. As stated earlier 
in A Proven Approach, forms and instruments were developed and field-tested in previous projects. 
They were included in the original proposal with descriptions of their development, reliability, 
validity, and uses. 

Evaluation activities focused primarily on assistance to leadership personnel, to sites and to 
direct service individuals in learning to use the evaluation procedures with accuracy and to use the 
results (both formative and summative) in ways that improve and sustain performance. Figure 3, 
page 35 of the original proposal contains the summary of the evaluation plan for the competencies, 
evaluation sources, and performance standards for certification as a Regional Associate. 

Reliable data collection at ongoing service program sites is a well-documented challenge. 
It proved to be so for this project as well. In order to assure confidence in reliability of the data and 
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in the accuracy of the findings, smaller numbers were accepted in our samples. While this approach 
introduced a question of bias into the selection process, we chose samples which had reliable data, 
excluding those where data were incomplete or inaccurately collected. We believe the smaller 
samples are representative of the typical participants, children served, sites, and outcomes. 

Effectiveness of this project was assessed on four dimensions: (a) observational measures 
of participants’ performance in using the specified practices; (b) progress of the children served by 
the participants during model implementation; (c) satisfaction of the participants with the training; 
and (d) assessment of administrative support for model implementation. Results are presented below. 

Evaluation of Outreach Project Effectiveness 

Was the outreach effective in assisting individuals and programs to improve and expand 
services to students with severe social-emotional-behavioral disabilities (SEED)? To answer this 
question, the evaluation focused on project services provided for each task and recipient groups and 
are described here: 

Evaluation questio n Task 1 . To what extent was multi-media information provided about the 
model and how does it address the needs of students with SEED? The recipient groups included 
public, professionals, paraprofessionals, and parents. Responses from recipients of dissemination 
materials was highly positive. Often requests for portfolios, brochures, bookmarks and flyers came 
from individuals who heard of project activities from other recipients. Participants in conference and 
workshop presentations rated the overall value, content and process of information as 4.57, using 
a scale of 1 to 5 with 1 being of little benefit and 5 highly beneficial. 

Evaluation questions Task 2. Do participants in the Training Trainers Program meet 
specified requirements for certification as a Regional Associate (RA)? Do they indicate satisfaction 
with the usefulness of project services? Do they report a positive view of their own skills as a new 



outreach provider? 

Of the 33 leadership personnel meeting the requirements and accepted into the program, 17 
participants successfully completed all requirements in the five competency areas and received 
certification during the project, five continue to work toward certification, and 1 1 discontinued their 
efforts for personal and/or professional reasons. Tables 4a and 4b summarize the progress of these 
RA leadership participants toward achievement of the specified standards for each of the five 
competency areas. Results of evaluation activities for this program component are summarized here: 

Competency 1. Knowledge: The 50-item multiple-choice test of knowledge about 
Developmental Therapy-Developmental Teaching was taken by all but one of the RAs at the 
beginning of their training. Post-training knowledge tests were administered on an individual basis, 
when RAs requested the test after periods of self-study or as they came to the end of their 
individualized leadership training program. Of the 21 active RAs, 17 achieved the passing criterion 
(80%) or greater. Four of the remaining RAs continue their independent progress toward 
certification as Developmental Therapy-Developmental Teaching Regional Associates. 

Competency 2. Reliability in using the 171-item DTORF-R assessment procedure: 
Leadership participants were expected to participate in team assessments of children in their 
programs and to review all DTORF-R ratings for accuracy. This procedure is a quality check on 
reliability of the assessment and requires proficiency in the use of the instrument on the part of the 
RA. Each rating was then reviewed by the project instructor for accuracy in the rating procedure and 
reliability of rater judgments. The instructor identified problem areas or inaccuracies in the rating 
procedure and provided feedback to the RA and the rating team. When DTORF-R ratings at a site 
were accepted as reliable and valid measures by the instructor, the RA was judged to have passed 
Competency 2, DTORF-R reliability. Using this procedure, 21 RAs received a "pass", indicating 
competency in supervising team ratings of social-emotional-behavioral development. 



ERIC 



18 



26 



Table 4a. Developmental Therapy - Teaching Programs 
Certifled Regional Associates 
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Table 4a. (continued) 
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Table 4b. Developmental Therapy-Teaching Programs 
Regional Associates Certiflcation in Process 
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RAs beginning program during Year Three 



Competency 3. Reliability in using the 212-item DTRITS observational rating form: RAs 
were expected to observe with the project instructor as teaching teams worked directly with groups 
of children during implementation of model practices. These parallel observations were made during 
each return visit of the project instructor, and practice DTRITS ratings were made independently 
by the RA and the instructor. Follow-up discussion of rating differences on particular items 
following an observation served as tutorials for the RAs. This procedure was repeated with each visit 
until the DTRITS rating by a RA reached 80% agreement with the project instructor. Using this 
procedure, 19 RAs reached the performance criterion to date. (There is a further discussion below 
about the difficulties of leadership individuals in freeing an uninterrupted hour to complete an 
observation and DTRITS rating.) 

Competency 4. Field supervision: Each RA was expected to provide on-going inservice 
assistance to their staff for model implementation during the periods between project instructors’ 
visits. At the conclusion of the training agreement, or at the time when the RA and project instructor 
believed that implementation had reached an acceptable replication level, the teams were asked to 
anonymously rate the quality and effectiveness of the RA in assisting them in effective 
implementation. Using this procedure, 1 7 RAs completed the requirement successfully by receiving 
average ratings of 4 or better on an 8-item form with a 5-point rating scale. Results ranged from 4.04 
to 4.79 on the individual items with an overall average of 4.26 (See Table 5, Average Ratings of 
Trainer’s Field Skills). As this outreach project ends, four others are actively in process of guiding 
their program staff in model implementation. 

Competency 5. Group instruction in basic model elements: Three phases of training were 
used to assist the RAs in developing effective skills in leading staff workshops for model 
implementation. The first phase, completed by 20 of the RAs, involved co-teaching with a project 
instructor for which planning was a combined effort between the instructor and RA. The second 
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Table 5. Average Ratings of Trainer’s Field Skills 

(n = 28) 





Average Rating* 


Overall contribution of trainer to your own growth in implementing 
DTT practices. 


4.11 


Trainer’s knowledge of content. 


4.79 


Trainer’s skill in explaining what you needed to do. 


4.33 


Trainer’s practical skills in assisting you in putting ideas into practice. 


4.26 


Trainer’s ability to help you acquire the necessary skills to conduct the 
program independently. 


4.07 


Receptivity of trainer to your needs. 


4.39 


Compare this field-based training with other training you have received. 


4.11 


Rate the overall success of your DTT program for the children during 
the time this trainer was assisting you. 


4.04 


Overall Average 


4.26 



"■ 1 = poor, 2 = fair, 3 = good, 4 = very good 5 = superior 



phase, completed by 22 RAs, required independent presentations when there was no co-teaching 
but the project instructor assisted the RA in planning, selecting strategies, and designing effective 
workshop materials. The third phase for certification was successfully accomplished by 17 RAs in 
which they independently planned all aspects of the workshop, led the session, and were evaluated 
by a project instructor on an 18-item rating form with a 5-point scale of effectiveness as a session 
leader. Results of these ratings reported in Table 6 indicate an overall average of 4. 18 with a range 
on individual items of 3.65 (eliciting responses from non-participants) to 4.53 (using the group 
process as the vehicle for learning). Additionally, workshop participants rated these sessions 4.0 or 
greater. 

Appendix C lists and summarizes workshop evaluations from 2,194 participants at 105 
workshops and presentations during the project years. (It should be noted that not all of the 



Table 6. Session Leader’s Skills for Involving Participants in Active Learning 

(n = 20 ) 





Average Rating* 


Communicating purpose of session 


4.45 


Communicating value of session 


4.19 


Conveying adequate information on topic 


4.10 


Supporting individual participant’s effort 


4.20 


Supporting the group effort 


4.42 


Eliciting responses from non-participants 


3.65 


Motivating the group 


4.21 


Providing structure when needed 


4.26 


Allowing looseness when needed 


4.22 


Exhibiting personal verbal communication 


4.43 


Using non-verbal, body language 


4.29 


Turning participant “mistakes” into contributions 


3.83 


Understanding what a participant is trying to say and relating it to the 
topic 


4.05 


Pacing and timing 


3.90 


Introducing the session 


4.50 


Ending the session 


3.72 


Using the group process as the vehicle for learning 


4.53 


The overall effectiveness of this session for the group 


4.21 


Overall Average 


4.18 



* 1 = ineffective, 2 = fair, 3 = average, 4 = very good, 5 = highly effective 



participants at these workshops completed the anonymous evaluation forms.) Using a scale from 
5 {Highly Satisfied) to 1 {Not Satisfied), the respondents indicated high degrees of satisfaction, with 
average ratings ranging from 3.51 to 5.0. Twenty-five of these workshops with 584 participants 
were taught independently by leadership participants in the RA Training-Trainers Program or by 
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certified RAs. Using the same evaluation form, respondents expressed similar levels of satisfaction 
with the material, workshop organization, general impression of the workshops, and the extent to 
which their individual needs were met. These average ratings ranged from 4.18 to 5.0. 

Satisfaction of leadership trainees (RAs). Formative feedback on the training experiences 
was undertaken yearly throughout the project. Trainees participated in a focus group (Year One), 
an on-line survey (Year Two) and three phone conferences (Year Three) to evaluate the 
development of their own skills, the response to the training they were providing, the strengths and 
weaknesses of the leadership training and recommendations. Also, as each RA reached certification, 
they were asked to complete a written evaluation of the training experiences. This feedback provided 
the mentoring national instructors with helpful recommendations for improving the training as well 
as a summative evaluation of this aspect of the project. Table 7 includes the average of an 8-item 
form with a 5-point rating scale with 1 being poor and 5 superior, the average rating by RAs of their 
overall Regional Associates’ training experience was 4.56 with individual items ranging from 4. 16 
( Fa/ue of the experiences in broadening your understanding of the ways in which troubled children 
and youth are served) to 4.89 (Skills of the instructors from the DT-TP who worked with you). 

The series of three long-distance phone conferences for focused dialogue about issues and 
concerns of RAs was conducted in December, 2002. Appendix D contains the topics, specific 
questions and format for each discussion and a summary of the results. A total of 1 6 individual RAs 
participated in these phone discussions. Evaluation results indicated high satisfaction for this form 
of interactive dialogue. The ratings (Table 8) were summed to get an average overall rating (4. 1 7) 
as well as averages for three categories: process (4.25), content (4.25) and value (4.00). Criteria for 
effectiveness was set at >4.0. 

RAs were articulate about their own strengths and weaknesses and were able to suggest very 
specific ways in which the project staff could assist them further in gaining the skills they needed. 
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Table 7. Average Ratings of Regional Associate’s Training Experience 

(n=17) 





Average Rating* 


Overall value of this experience for you. 


4.53 


Overall quality of the training program in which you participated. 


4.32 


Skills of the instructors from the DT-TP who worked with you. 


4.89 


Value of the experiences in broadening your understanding of the ways 
in which troubled children and youth are served. 


4.89 


Value of the experiences in providing you with future career directions. 


4.16 


Usefulness of the experiences in teaching you new methods and 
procedures for working with teachers who use DTT. 


4.53 


Usefulness of the training to use with reliability the materials for 
assessment of student progress and teacher skills. 


4.58 


Effectiveness in expanding your skills for program supervision and 
conducting staff development. 


4.63 


Effectiveness of the experience for increasing your knowledge of new 
theory, research, and practice with applications to intervention programs 
for troubled children and youth. 


4.53 


Overall Average 


4.56 



* 1 = poor, 2 = fair, 3 = good, 4 = very good, 5 = superior 



Table 8. Evaluation of Telephone Conferences, Year Three 

(n=16) 





Average Rating* 


Process 

(the way the sessions were organized and conducted) 


4.25 


Content 

(conference subject matter) 


4.25 


Value 

(usefulnes of the phone conferences for you) 


4.00 


Overall Average 


4.17 



*5 point scale with 1 being of little benefit and 5 highly beneficial 
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They urged regular contact via distance and on-site connections. They requested project instructors 
to continue visiting and monitoring their activities and programs; guidance in setting up grant- 
funded pilot programs, in obtaining resource materials and audio-visual aids, in training for model 
implementation, and on-line training materials. They also suggested a bi-aimual leadership 
conference bringing together RAs from across the country for in-depth immersion in leadership 
issues. 



Their recommendations included greater assistance with presentations, opportunities to 
practice presentations with peers for feedback, increased diversity of participating RAs, and 
increased time needed for preparation of presentations. They expressed some disappointment in the 
value of self-help/peer study groups where they attempted to learn from each other. 

In discussion about the training they provided others, the RAs were positive and confident 
of their present level of skill for supporting others in schools, consultation and informal training with 
parents, presenting workshops and training new staff in introductory and intermediate levels of 
model implementation, using the model for FBA and Positive Behavioral Intervention Plans, and 
informally supporting staff in consultation about individual children’s needs. They generally felt that 
their work with the project and with their staff was well received but were concerned that 
presentations offered only at the basic level fail to meet the needs of advanced participants. Several 
RAs expressed their movement toward a tiered training format-aimual goals for staff inservice are 
set and staff participate in introductory or advanced sessions depending on their level of knowledge. 
Also, these sites have reported using their most experienced staff to mentor newer staff throughout 
the year. Treatment meetings are designed to focus on model components as well. 

RAs plans for training others in the future included foster parent training, continuing on-site 
staff training, consultation with other school districts, and training in positive behavior management 
for general and special educators, administrators, and mental health persoimel. They had numerous 
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future plans using the model. These included finding grant funds for expanding the scope of their 
program’s model implementation, using the assessment instruments at a statewide level, extending 
the model into regional school districts, and expanding the curriculum resources for the model. 

Evaluation questions Task 3 . Do participants demonstrate specified performance skills for 
implementing the model in the service setting? Do participants report a positive view of their own 
skills for implementing the model? Do their students show significant progress in achieving their 
lEP goals for increased social-emotional competence and responsible behavior? Has the 
implementation site achieved the specified standards for an effective replication? 

The recipient groups for this task were the local service sites with (a) direct service providers 
(teachers, administrators, support personnel), concerned parents, and (b) students with SEED who 
have lEP goals for social-emotional competence and responsible behavior. Appendix E outlines 7 
competencies, data sources and performance standards used to answer these questions for Task 3, 
including observational/judgment performance ratings, document review for accurate use of 
instruments used in model implementation, checklists and open-end questionnaires to measures 
participant satisfaction. These measures have been extensively field-tested, revised, and proven to 
be reliable, valid, and useful in previous studies documenting model effectiveness with students who 
have severe social-emotional-behavioral disabilities. 

Performance criteria for effectiveness was measured (a) with direct service providers by their 
demonstrated skill in implementing specified model practices when observed in direct work with 
their students and their satisfaction with the usefulness of the model practices they have acquired; 
(b) for the students by documented progress toward achieving specific lEP goals for social- 
emotional competence and responsible behavior; and, (c) quality of replication at each site judged 
by the extent to which previously established standards for an effective replication are met. 

Specified performance skills for implementing the model in the service setting . The skills 
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of the teaching teams in working effectively with children/students were assessed with the 
Developmental Therapy Rating Inventory of Teaching Skills (DT/RITS). Typically an observation 
and rating was followed by a 30 to 60 minute debriefing for feedback with the teaching team, 
focusing on satisfactory skills and areas of performance that required improvement. At the time 
implementation activities began at a site, the project instructor and the Regional Associate(s) 
observed each participating team. Once certified, RAs continued implementation activities and rated 
participating teams independently. 

Table 9 reports the DT/RITS scores achieved by 62 teams at 17 representative sites after 
initial model implementation, performance feedback, and tutorial assistance. Levels of proficiency 
established for DT/RITS scores in previous studies are 90-l00=Highly Effective, 10-^9=Effective, 
50-69=Adequate, 30-49=Less than Adequate, and \6-29=Poor. The scores indicate that 46 (74%) 
teams achieved DT/RITS proficiency scores at ihe Adequate or better level, indicating demonstration 
of the basic practices necessary for model implementation. Of these, 33 (53%) teams demonstrated 
Effective or Highly Effective skills. 

A positive view of their own skills for model implementation . To obtain information about 
participants view of their own skills and their level of satisfaction in on-site training for model 
implementation, a one-page questionnaire was mailed, electronically sent or faxed to RAs at all sites 
agreeing to participate in project evaluation activities for distribution. Support staff, administrators, 
and direct service team members were included. Using a scale from Yes I have acquired this skill 
(5) to No{\), they were asked to rate 22 items about their perceptions of skills they had acquired as 
a result of training, positive aspects and weaknesses of the training they received, changes in their 
effect on children and families, and recommendations for future training. 
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Table 9. Sample of Observation Performance Ratings 
by Direct Service Achieved at Current Sites 



Participant 

Teams 


DTRITS Scores and 

Proficiency Levels Achieved as of December, 2002 


Site 


Team 


Highly Effective 


Effective 


Adequate 


Below Passing 


ID 


ID 


90 - 100% 


70 - 89% 


50 - 69%o 


<50% 


001 


002 






69 






003 








38 




006 


95 








003 


001 


93 










002 


100 










004 








45 




008 


97 










009 








33 




012 








33 


005 


003 




76 








004 






65 






006 


95 










007 




75 






007 


Oil 








33 




013 


95 










015 


93 








014 


005 


100 








016 


001 




81 








002 




86 








004 




88 








005 








46 




006 




73 








008 




88 








009 




89 








010 








21 




Oil 




81 








014 




84 








015 


94 










016 




85 








017 








33 




019 


100 










020 


100 










021 


95 








018 


004 






64 






005 








48 




30 

38 



023 


001 








37 




002 








34 




004 






51 






005 








26 


024 


001 








45 




002 




88 








004 








37 




005 






64 






on 






58 






012 




88 






025 


001 




78 






027 


001 




83 








002 






66 






003 






67 






004 






62 






005 






66 






006 








44 


028 


003 




77 








005 




88 






029 


008 




87 






031 


001 






51 




032 


001 




88 








002 








25 


035 


001 






63 






002 






69 






003 




87 






036 


001 


91 








Total 

Teaching 

Teams 


62* 


13 


20 


13 


16 



*Teaching teams consisted of the lead teacher and one or more paraeducators. 



Responses were received from 4 1 participants. T able 1 0 summarizes their ratings, indicating 
levels of skill achievement ranging from above average (ratings > 3.5) to highly effective (ratings 
of 4.89). Responses to the statements of newly acquired skills included understanding the social- 
emotional development of children better (4.43), skill in preparing a group profile to identify the 
range of social-emotional objectives within my group (3.89), recognize anxieties behind behavior 
(4.32), and conduct every activity, including transitions and free time, to work on specific goals and 
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Table 10. Direct Service Personnel Questionnaire Totals 



Know the developmental milestones each child in my group has achieved. 4.43 

Know the objectives that are the current focus of my classroom/treatment program. 4.54 

Prepare group profile to identify the range of social-emotional objectives within my group. 3.89 

Plan group activities with adaptations for individuals based on their objectives. 4.35 

Plan lead and support role strategies with my team. 4.46 

Have learned the developmental goals and milestones for the stages above and below the 4.14 
current level of my group. 

Have posted, student friendly schedule for our daily routine. 4.86 

Plan activities around content themes generated from experiences/interests of group. 4.24 

Know how each of my students responds to stress and success. 4.57 

Anticipate students’ behaviors and respond within the context of each student’s stage of 4.32 
development. 

Recognize anxieties behind observed behavior. 4.32 

Respond to behaviors in ways that reduce anxieties. 4.41 

Convey necessary psychological power to ensure security for everyone in group. 4.38 

Make my own needs secondary to those of the students. 4.76 

Convey calm dependability and competence under stress. 4.43 

Adjust actions and procedures and alter activities as needed to foster change in students. 4.41 

Work with other mental health and educational professionals as a member of the 3.59 

interdisciplinary team effort to assist my students and their families. 

Assist other adults to ensure successful integration of my students into the general education 4.00 
program. 

Use knowledge of anxieties, defense mechanisms, and roles in groups to plan and conduct 4.41 
activities. 

Conduct every activity, including transitions and free time, to work on specific goals and 4.03 
objectives. 

Monitor each student’s progress carefully to facilitate advancement to new objectives. 4.27 

Use DTORF-R at each grading period to interpret progress and make changes. 4.08 

Average Overall Rating 4.31 






objectives (4.03). Even the skill receiving the lowest score (3.59) "Work with staff and other 
educational professionals as a member of the interdisciplinary team effort to assist my students and 
their families." was still rated above average. 

RAs held informal sessions with staff concerning the training activities. Their cited strengths 
included the organization of the workshop/training sessions, using their students as relevant 
examples, the small group exercises, and opportunities to analyze in-depth individual cases. They 
also mentioned knowledge levels, helpfulness, support, and skills of project instructors in providing 
practical applications as strengths in the training. The reported weakness of the training focused 
almost entirely on issues of time. They felt that the comprehensiveness of the curriculum required 
in-depth work beyond what can be done given all the other daily requirements. They felt a shortage 
in number of scheduled observations and feedback they received (time limitations on the part of the 
visiting instructor’s schedule) and training after school when they were tired or scheduled to leave. 
They also reflected that they would have liked more direct suggestions for activities, curriculum 
ideas, follow-up case studies, and applications in the classroom for targeting goals and objectives. 

Significant progress in childrens’ social-emotional-behavioral competence during the model 
implementation period. To evaluate project impact on children served by the participants during 
model implementation, 1 1 sites agreed to assist us in collecting basic descriptive data and periodic 
assessments of social-emotional-behavioral status using the Developmental Teaching Objectives 
Rating Form Revised (DTORF-R). The DTORF-R consists of 1 7 1 items measuring social-emotional 
competence in four interactive subscales - Behavior Subscale - 33 items; Communication Subscale - 
35 items; Socialization Subscale - 41 items; and, Pre (Academics) Subscale - 62 items. Reliability 
studies report item-by-item interrater agreement of .95 and .98 using a standard rater-training 
program. Kuder-Richardson t}q5e estimates of internal reliability are about .99 for each DTORF-R 
subscale. 
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DTORF-R ratings were completed by rating teams, usually the teaching team working with 
the child at the program site, a parent or parent worker and a site RA. The site RA was trained 
specifically in the use of the instrument. All children served by the participants at these sites were 
included if their DTORF-R ratings for social-emotional-behavioral development were completed 
with accuracy and there was at least one repeated assessment of 2 months but no greater than 1 1 
months apart. Appendix F contains the criteria set to assure qualitative control of the DTORF-R 
assessment profiles. These include age - stage and interdomain congruity. There were 279 of 519 
children with assessment information whose ratings met the criteria to be included in the sample. 

Descriptive Statistics 

Table 11 summarizes the characteristics of these children at the time model implementation 
was initiated. The sample was composed of a total of 279 children from 1 1 programs in 6 states. 
Overall there were 207 (74. 1 9%) males and 72 (25 .81%) females. T wo hundred forty-five (87. 82%) 
of the sample were African American 103 (36.92%) or Caucasian 142 (50.90%). They ranged in age 
from 8 months to 247 months (20.58 years), with an average age of 7.25 years (87.01 months). All 
had at least one recorded primary disability, 166 (59.50%) were children with severe 
emotional/behavioral disabilities (SEBD), 45 (16.13%) with Autism Spectrum Disorders, and 25 
(8.96%) with Pervasive Developmental Delay (PDD); 106 (37.99%) had SEBD as a secondary 
disability. 84.23% of these children (235) were being served in special education classes while 
15.05% (42) were reported in full inclusion or partial inclusion settings. 

For the analysis of program effect on severity levels, a severity index was calculated for each 
child by dividing a child’s actual DTORF-R developmental score at entry by the expected 
developmental score (DTORF-R developmental score corresponding to the child’s chronological 
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Table 11. Characteristics of Sample Populations 

(n = 279) 





n 


Percent 


Gender 


Male 


207 


74.19 




Female 


72 


25.81 


Race 


African American 


103 


36.92 




Caucasian 


142 


50.90 




All others 


34 


12.19 


Program Level 


Pre-School 


90 


32.26 




Elementary 


150 


53.76 




Middle School 


16 


5.73 




Other 


57 


20.43 


Primary Disability 


Autism 


45 


16.13 




Developmental 


25 


8.96 




Emotional/Behavioral 


166 


59.50 




Other 


43 


15.41 


Secondary Disability 


Emotional/Behavioral 


106 


37.99 


Service Type 


Inclusion 


42 


15.05 




Special Class 


235 


84.23 




Other 


1 




Severity 


Mild 


120 


43.01 




Moderate 


138 


49.46 




Severe 


20 


7.17 




Other 


1 


0.36 



age at entry). Three standards have been previously defined for this severity index: Children 
entering with no more than a 25% delay in expected developmental scores are classified in the mild 
group; scores between 26% and 74% indicate moderate delay; and scores indicating 75% delay or 
greater are designated as severe. Of the 279 children in the sample, 120 (43.01%) were classified 
as mild, 138 (49.46%) as moderate and 20 (7.17%) as severe; one (0.36%) was in the range 
comparable to same age peers. For the analyses of program impact on children across program levels 
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from preschool to secondary, three groups were established: Preschool (under 5 years), Elementary 
(Kindergarten through 5* grade) and Secondary (6“’ to 8“’ grades). 

Inferential Statistics 

The independent variable was participation in the Developmental Therapy-Teaching model. 
The pre-DTORF-R (beginning of treatment) and the post DTORF-R (end of treatment) for all 
children were used as the dependent variables. The range of number of months in treatment was 2 
to 36 months (mean 8.78). The null hypothesis for statistical tests was either no statistically 
significant difference between mean DTORF-R Pre and mean DTORF-R Post or no statistically 
significant difference for mean gain scores as corrected by number of months in treatment. Several 
inferential statistical tests were used to analyze the data for potential differences. 

Overall Analyses . For the entire sample, a dependent t-test using pre and post DTORF-R 
scores as the dependent variable was calculated for each of the four areas-Behavior, 
Communication, Socialization and Pre (Academics) (See Table 12). The results were as follows: 
Behavior (t=l 1 . 1 8,p <.000), Communication (t-1 1 .68, p<.000). Socialization (t-12.41 , p<.000) and 
(Pre) Academics (t=10.36, p<.000). Thus, there were statistically significant gains for the sample 
as a whole for all four areas at the p<.000 level for the total sample. These findings indicate that 
model implementation by the participating teams had a significantly positive effect in promoting 
increased social-emotional-behavioral development of the children that they served. 

More Specific Analyses . Based on the statistically significant results for all four areas, 
additional analyses were conducted to determine possible differences on other variables. Analyses 
were conducted for severity level, program level and disability categories. Additional analyses using 
the covariate of number of months in treatment were conducted for gender and race. 
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Table 12. Overall Analysis of Pre/Post DTORF-R Scores 

(n = 279) 





Mean 


Standard Deviation 


Dependent t 


P 


Behavior 


Pre DTORF-R 


11.30 


5.03 


X 


X 




Post DTORF-R 


13.77 


5.76 


X 


X 




Statistical Test 


X 


X 


11.18 


p<.000 


Communication 


Pre DTORF-R 


10.91 


5.69 


X 


X 




Post DTORF-R 


13.32 


6.26 


X 


X 




Statistical Test 


X 


X 


11.68 


p<.000 


Socialization 


Pre DTORF-R 


13.60 


6.27 


X 


X 




Post DTORF-R 


16.48 


6.59 


X 


X 




Statistical Test 


X 


X 


12.41 


p<.000 


(Pre) Academics 


Pre DTORF-R 


20.75 


14.60 


X 


X 




Post DTORF-R 


24.94 


14.90 


X 


X 




Statistical Test 


X 


X 


10.36 


p<.000 



Severity Level . A dependent t-test focusing on Severity Level-a potentially significant 
variable concerning the viability of the model across multiple severity levels-was calculated for 
three severity levels (Severity Level 1 - 25% delay or less = the mild group; Severity Level 2 - 
26% and 74% delay = moderate; and Severity Level 3 - 75% delay or greater = severe) for each of 
the four DTORF-R areas. Table 13 presents the results of these analyses. There were statistically 
significant differences in Severity Levels at the p<.000 level for Severity Levels 1 and 2 for all four 
areas-Behavior, Communication, Socialization and (Pre) Academics. The students in Severity Level 
3 (n=20) made less statistically significant gains than those in Severity Levels 1 and 2; however, 
gains here were still substantial (Behavior: t = 3.50, p<..002; Communication: t =2.38, p<..028; 
Socialization: t = 3.14, p<.005; and, (Pre) Academics: t =2.32, p<.032). 
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Table 13. Analyses of Pre/Post DTORF-R Scores by Severity 

(n = 278) 





Mean 


Standard Deviation 


t 


p 


Severity Level 1 - Mild (n = 120) 










Behavior 


Pre DTORF-R 


13.13 


4.54 


X 


X 




Post DTORF-R 


15.45 


5.36 


X 


X 




Statistical Test 


X 


X 


7.05 


p<.000 


Communication 


Pre DTORF-R 


13.78 


4.20 


X 


X 




Post DTORF-R 


15.92 


4.81 


X 


X 




Statistical Test 


X 


X 


7.10 


p<.000 


Socialization 


Pre DTORF-R 


16.62 


4.99 


X 


X 




Post DTORF-R 


18.81 


5.35 


X 


X 




Statistical Test 


X 


X 


6.70 


p<.000 


(Pre)Academics 


Pre DTORF-R 


29.24 


10.82 


X 


X 




Post DTORF-R 


32.85 


10.89 


X 


X 




Statistical Test 


X 


X 


7.59 


p<.000 


Severity Level 2 - Moderate (n = 138) 










Behavior 


Pre DTORF-R 


10.71 


4.77 


X 


X 




Post DTORF-R 


13.33 


5.63 


X 


X 




Statistical Test 


X 


X 


7.94 


p<.000 


Communication 


Pre DTORF-R 


9.78 


5.43 


X 


X 




Post DTORF-R 


12.60 


6.04 


X 


X 




Statistical Test 


X 


X 


9.10 


p<.000 


Socialization 


Pre DTORF-R 


12.38 


5.94 


X 


X 




Post DTORF-R 


15.94 


6.54 


X 


X 




Statistical Test 


X 


X 


10.24 


p<.000 


(Pre)Academics 


Pre DTORF-R 


15.98 


14.08 


X 


X 




Post DTORF-R 


21.04 


14.73 


X 


X 




Statistical Test 


X 


X 


7.35 


p<.000 


Severity Level 3 - Severe (n = 20) 


Behavior 


Pre DTORF-R 


4.75 


1.89 


X 


X 




Post DTORF-R 


7.05 


2.76 


X 


X 




Statistical Test 


X 


X 


3.50 


p<.002 


Communication 


Pre DTORF-R 


2.05 


1.28 


X 


X 




Post DTORF-R 


3.20 


2.09 


X 


X 




Statistical Test 


X 


X 


2.38 


p<.028 


Socialization 


Pre DTORF-R 


4.40 


2.09 


X 


X 




Post DTORF-R 


6.85 


2.74 


X 


X 




Statistical Test 


X 


X 


3.14 


p<.005 


(Pre)Academics 


Pre DTORF-R 


3.55 


2.54 


X 


X 




Post DTORF-R 


5.40 


2.80 


X 


X 




Statistical Test 


X 


X 


2.32 


p<.032 
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Program Level . Another potentially significant variable considered important was the impact 
potential of the model on children across program levels. Calculations were made with a dependent 
t-test using pre and post DTORF-R scores as the dependent variable for each of the four 
areas-Behavior, Communication, Socialization and (Pre) Academics - for three identified program 
levels. Preschool (under 5 years, n=105). Elementary (K to 5* grade, n = 1 16) and Secondary (6* - 
8* grade, n = 16) (See Table 14 for results). There were statistically significant differences in 
Program Levels at the p<.000 level for Preschool and Elementary for all four areas-Behavior, 
Communication, Socialization and (Pre) Academics. Compared with these levels, students in 
Secondary Level (n = 16) made less statistically significant gains in Communication (t = 2.89, 
p<.011) and statistically significant gains were not indicated in Behavior (t = 1.86, p<.083); 
Socialization (t = 1.26, p<.226); or, (Pre) Academics (t = 1.64, p<.122). 

Primary Disability . DTORF-R pre/post scores for the four subscale areas were analyzed 
according to the type of disability used by the site at the time of enrollment. Three primary disability 
types were identified: Emotional/Behavioral (n = 166), Autism Spectrum (n = 45) and Pervasive 
Developmental Delays (n = 25). Table 15 summarizes the results of these analyzes. Statistically 
significant t-values (p<.000) were denoted in all four areas for children with emotional/behavioral 
disabilities. Similar findings were indicated for children with Autism in Socialization (t = 3.43, 
p<.001) and for children with PDD in Communication (t = 3.74, p<.001). Socialization (t = 4.46, 
p<.000) and (Pre) Academics (t = 3.73, p<.001). Though meaningful, children with Autism made 
less statistically significant gains in (Pre) Academics (t =2.39, p<.021) as did children with PDD in 
Behavior (t = 2. 1 6, p<.04 1 ). Significant gains were not shown for children with Autism in Behavior 
(t =1.70, p<.097) and Communication (t =1.19, p<.242). 
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Table 14. Analysis of Pre/Post DTORF-R Scores by Program Levels 





Mean 


Standard Deviation 


Dependent t 


P 


Preschool ( n = 105) 


Behavior 


Pre DTORF-R 


8.53 


2.85 


X 


X 




Post DTORF-R 


10.42 


3.49 


X 


X 




Statistical Test 


X 


X 


7.74 


p<.000 


Communication 


Pre DTORF-R 


8.34 


4.14 


X 


X 




Post DTORF-R 


10.49 


4.06 


X 


X 




Statistical Test 


X 


X 


8.71 


p<.000 


Socialization 


Pre DTORF-R 


10.53 


4.47 


X 


X 




Post DTORF-R 


13.10 


4.32 


X 


X 




Statistical Test 


X 


X 


9.26 


p.<000 


(Pre)Academics 


Pre DTORF-R 


15.71 


8.55 


X 


X 




Post DTORF-R 


20.15 


8.67 


X 


X 




Statistical Test 


X 


X 


8.67 


p<.000 


Elementary ( n = 116) 


Behavior 


Pre DTORF-R 


13.08 


4.86 


X 


X 




Post DTORF-R 


16.68 


5.49 


X 


X 




Statistical Test 


X 


X 


9.00 


p<.000 


Communication 


Pre DTORF-R 


12.72 


5.48 


X 


X 




Post DTORF-R 


15.72 


6.41 


X 


X 




Statistical Test 


X 


X 


8.46 


p<.000 


Socialization 


Pre DTORF-R 


15.57 


6.07 


X 


X 




Post DTORF-R 


19.38 


6.40 


X 


X 




Statistical Test 


X 


X 


9.12 


p.<.000 


(Pre)Academics 


Pre DTORF-R 


23.33 


16.65 


X 


X 




Post DTORF-R 


27.75 


17.34 


X 


X 




Statistical Test 


X 


X 


6.50 


p<.000 


Middle School (n = 16) 


Behavior 


Pre DTORF-R 


16.50 


4.77 


X 


X 




Post DTORF-R 


18.50 


5.85 


X 


X 




Statistical Test 


X 


X 


1.86 


p<.083 


Communication 


Pre DTORF-R 


15.69 


5.21 


X 


X 




Post DTORF-R 


18.06 


6.60 


X 


X 




Statistical Test 


X 


X 


2.89 


p<.011 


Socialization 


Pre DTORF-R 


20.56 


6.25 


X 


X 




Post DTORF-R 


21.81 


6.75 


X 


X 




Statistical Test 


X 


X 


1.26 


p.<.226 


(Pre)Academics 


Pre DTORF-R 


30.81 


17.79 


X 


X 




Post DTORF-R 


35.94 


17.34 


X 


X 




Statistical Test 


X 


X 


1.64 


p<.122 
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Table 15. Analysis of Pre/Post DTORF-R Scores by Primary Disability 

(n = 279) 





Mean 


Standard Deviation 


Dependent t 


p 


Emotional/Behavioral (n 


= 166) 










Behavior 


Pre DTORF-R 


12.37 


4.57 


X 


X 




Post DTORF-R 


15.43 


5.36 


X 


X 




Statistical Test 


X 


X 


11.05 


p<.000 


Communication 


Pre DTORF-R 


12.68 


5.05 


X 


X 




Post DTORF-R 


15.46 


5.35 


X 


X 




Statistical Test 


X 


X 


10.93 


p<.000 


Socialization 


Pre DTORF-R 


15.43 


5.56 


X 


X 




Post DTORF-R 


18.50 


5.93 


X 


X 




Statistical Test 


X 


X 


10.10 


p.<000 


(Pre)Academics 


Pre DTORF-R 


25.20 


13.34 


X 


X 




Post DTORF-R 


30.22 


13.01 


X 


X 




Statistical Test 


X 


X 


10.73 


p<.000 


Autism (n = 45) 


Behavior 


Pre DTORF-R 


9.71 


5.87 


X 


X 




Post DTORF-R 


10.78 


5.56 


X 


X 




Statistical Test 


X 


X 


1.70 


p<.097 


Communication 


Pre DTORF-R 


7.02 


5.79 


X 


X 




Post DTORF-R 


7.73 


5.71 


X 


X 




Statistical Test 


X 


X 


1.19 


p<.242 


Socialization 


Pre DTORF-R 


10.07 


6.51 


X 


X 




Post DTORF-R 


12.09 


5.93 


X 


X 




Statistical Test 


X 


X 


3.43 


p.<.001 


(Pre)Academics 


Pre DTORF-R 


14.58 


12.94 


X 


X 




Post DTORF-R 


16.98 


13.58 


X 


X 




Statistical Test 


X 


X 


2.39 


p<.021 


Pervasive Developmental Delay (n = 25) 


Behavior 


Pre DTORF-R 


9.16 


5.26 


X 


X 




Post DTORF-R 


10.24 


4.61 


X 


X 




Statistical Test 


X 


X 


2.16 


p<.041 


Communication 


Pre DTORF-R 


8.84 


5.58 


X 


X 




Post DTORF-R 


10.92 


5.66 


X 


X 




Statistical Test 


X 


X 


3.74 


p<.001 


Socialization 


Pre DTORF-R 


10.72 


6.50 


X 


X 




Post DTORF-R 


12.92 


5.61 


X 


X 




Statistical Test 


X 


X 


4.46 


p.<.000 


(Pre)Academics 


Pre DTORF-R 


17.60 


13.34 


X 


X 




Post DTORF-R 


19.96 


12.23 


X 


X 




Statistical Test 


X 


X 


3.73 


p<.001 
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Gender. The data was further investigated, an analysis of covariance (ANCOVA) was 
conducted to examine the sample for statistically different differences by gender as corrected by the 
number of months in treatment (covariate). A covariate was used to partition the variance as much 
as possible to determine gender differences. Table 16 provides the results of this analysis of 
covariance. The proportions of EBD males and females in this sample are generally consistent with 
the proportions found nationally for this disability area. The covariate was statistically significant 
at the p<.001 level indicating differences between students by number of months in treatment. As 
indicated in Table 16, there were no statistically significant differences between males and females 
in any of the four areas indicating that the model is equally effective with both males and females. 

Table 16. Analyses of Gain Scores by Gender 

(n = 279) 



Sample 


Mean Gain 


Standard 


Statistical Test 


Size 


Score 


Deviation 


F 



P 



Behavior Gains 



Male 

Female 

Covariant # months in 
Gender 





207 


2.46 


3.75 


X 


X 




72 


2.50 


3.53 


X 


X 


treatment 


X 


X 


X 


17.45 


p<.000 




X 


X 


X 


.133 


p<.715 



Communication Gains 



Male 

Female 

Covariant # months in 
Gender 





207 


2.23 


3.52 


X 


X 




72 


2.89 


3.15 


X 


X 


treatment 


X 


X 


X 


16.11 


p<.000 




X 


X 


X 


2.91 


p<.089 



Socialization Gains 



Male 

Female 

Covariant # months in 
Gender 





207 


2.81 


3.90 


X 


X 




72 


3.08 


3.84 


X 


X 


treatment 


X 


X 


X 


28.15 


p<.000 




X 


X 


X 


.80 


p<.373 



(Pre) Academic Gains 



Male 

Female 



207 

72 



4.00 7.10 

4.76 5.66 



X 

X 



X 

X 



Covariant # months in treatment 
Gender 



X 

X 



X 



X 



X 



X 



6.95 

1 



p<.009 



n< 11 1 



o 

ERIC 
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BEST COPY AVAILABLE 



R ace . An analysis of covariance (ANCOVA) was conducted to examine the sample for 
statistically significant differences by race as eorreeted by the number of months in treatment 
(covariate) using the same rationale as the analyses for Gender. An initial analysis of five races 
indicated no statistically significant differences for any of the four areas; however, the sample sizes 
for three of the races (Hispanic, Asian, and multi-racial) were very small compared to Caucasian 
and African American samples. Using a conservative analytical approach, an analysis of covariance 
was conducted with only these latter two categories. As seen in Table 17 below, the covariate was 
statistically significant at the p<.05 level for all four areas. However, there were no statistically 
significant differences in growth on the DTORF-R for any of the four areas. These results suggest 
that the model is equally effective with both Caucasian and African-American students. 

Table 17. Analyses of Gain Scores by Race 
(n = 245) 





Sample 

Size 


Mean Gain 
Score 


Standard 

Deviation 


Statistical Test 
F 


P 


Behavior Gains 






Caucasian 


142 


2.39 


3.48 


X 


X 




African American 


103 


2.90 


3.90 


X 


X 




Covariant # months in treatment 


X 


X 


X 


12.20 


p<.001 




Race 


X 


X 


X 


.16 


p<.690 


Communication Gains 






Caucasian 


142 


2.25 


3.50 


X 


X 




African American 


103 


2.56 


3.50 


X 


X 




Covariant # months in treatment 


X 


X 


X 


10.55 


p<.001 




Race 


X 


X 


X 


.00 


p<.958 


Socialization Gains 






Caucasian 


142 


3.00 


3.89 


X 


X 




African American 


103 


2.77 


3.53 


X 


X 




Covariant # months in treatment 


X 


X 


X 


21.27 


p<.000 




Race 


X 


X 


X 


1.92 


p<.167 


(Pre) Academic Gains 






Caucasian 


142 


4.70 


7.48 


X 


X 




African American 


103 


4.09 


5.28 


X 


X 




Covariant # months in treatment 


X 


X 


X 


4.75 


p<.030 




Race 


X 


X 


X 


1.26 


p<.262 



O 
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Overall Summary of Statistical Analyses 

As a group, the 279 children made statistically significant gains in social-emotional- 
behavioral competence in each subscale performance area during the intervention period providing 
evidence that significant gains occurred in behavior, communication, socialization and academics. 
When DTORF-R scores were then analyzed by various groupings— severity levels, program levels 
and disability type, significant values support the claim of program effectiveness in fostering gains 
at all severity levels, with preschool through upper elementary school, and among children who have 
varying disabilities. Gains scores with the influence of time partitioned out indicated that, though 
time in the program is significant, gender and race are not. The program was effective with both 
sexes and with Caucasians and African Americans. The findings provide clear evidence that troubled 
children, who may or may not have other disabilities, can make statistically significant gains in 
achieving individual objectives for social-emotional-behavioral development using the 
Developmental Therapy-Teaching practices for intervention. 

Implementation sites have achieved the specified standards for an effective replication. An 
administrative checklist containing 41 basic program elements desirable for effective model 
replication was used by project instructors and site administrators/coordinators to determine the 
extent to which model components had been included in the implementation effort. If a component 
was rated as provided and being used consistently, the item was marked YES. If it was used 
inconsistently, the item was marked PARTIAL, and if it was not available or not implemented, it 
was marked NO. The total items marked YES provided an administrative support score for a site. 
Criterion levels established in previous research studies on model effectiveness are these: 26-41 
items = Demonstration Level (components consistently and effectively replicated); 16-25 items = 
Model Adoption Level (sufficient number of elements to consider model implementation achieved); 
and 10-15 iXcms = Basic Implementation (Indicating essential components were utilized^. Table 18 
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reports the administrative support scores at each of the 1 1 implementation sites that participated in 
child progress data collection for the project. All of these sites were rated at the Basic 
Implementation level or better; indicating administrative planning that provided the essential 
elements for model implementation. Six sites were rated at the Model Adoption level, and five sites 
achieved Demonstration level. 



Table 18. Level of Administrative Support at Participating Sites 



Site 


Score* 


023 


17 


032 


24 


024 


22 


016 


29 


028 


13-23 


018 


25 


003 


28 


002 


32 


014 


37 


007 


33 


031 


NA 



* Score indicates number of administrative elements in place for model replication: 26-4 1 , Demonstration Level; 1 6-25, 
Adoption Level; 10-15, Minimum Level 
**Site has multiple locations 

Evaluation questions Task 4. To what extent have graduates of the Training Trainers 
Program independently conducted outreach activities for effectively implementing the model? Do 
they perceive that they have received sufficient support and guidance from project staff in support 
of their independent activities? Successful graduates of the Training Trainers Program (Task 2 
above), certified as Regional Associates were expected to independently assist others in replicating 
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the Developmental Therapy-Teaching model. As expected, once Regional Associates reached 
certification, they continued guiding implementation efforts with original teams and extended 
training to new teaching teams at their respective sites. Early in the project it was determined that 
to effectively train the trainer, aside from full staff workshops, training was modeled with one to 
three teaching teams with a focus on the RAs gaining competencies. As their skill increased, 
particularly after the field supervision period, RAs independently focused on additional teams. Data 
on workshops/training, student gains, and teacher skills was reported to our office on an established 
schedule. As site data was sent in, it was put into the data system established for each site. This 
information was included in the comprehensive data analyses described in Task 2 and Task 3 above. 

Appendix G, Evidence of Extended Training, contains information provided by Regional 
Associates about their activities in training others to use DTT practices. The opportunities the RAs 
are providing are as diverse as they are. One RA, a college professor, currently teaches a required 
graduate course "Models of Classroom Discipline" using the DTT text to 25 students each Spring. 
She is reworking a second course based on DTT for early education graduate students. This class 
generally has an enrollment of 1 0 students; it is offered each Fall. Some of the classes for this course 
are to be offered at Gateway-Longview, New York, a DTT program site. Thus, these courses have 
the potential to effect approximately 35 teachers and pre-service teachers annually. In this same 
vein, two Washington State RAs were contracted by a continuing education program to design a 45 
hour (4.5CEUs) course for early childcare providers using the DTT model. The class is scheduled 
to be conducted from June through August, 2003 for 20 participants. Also, an RA employed by the 
Jefferson Mental Health program (Port Townsend, Washington) developed a 10 month training 
program (55 hours) for School District special and regular education teachers. The training began 
September, 2002, and is ongoing through June, 2003. Training incorporates group seminars. 
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assessment and curriculum planning on, at least, two students, on-site observations and teacher 
mentoring. Fifteen teachers are participating in this program. 

Additionally, another RA, a state early childhood coordinator (Olympia, Washington), 
submitted and received state funding for a DTT project entitled A Training/Coaching Model for 
Improving Adult/Child Interactions in Childcare Settings. The program was conducted by four 
Regional Associate Instructors from June, 2001 through April, 2002. It consisted of four daylong 
workshops each two months apart interspersed with on-site observations and consultations to 28 
participants from eight childcare programs in a three county area. An RA employed by a statewide 
program for residential and group home care with headquarters in Lexington, Kentucky has 
succeeded in impacting the entire program. Their CEO for Children’s Services accepted her proposal 
for incorporating training in DTT model practices into their Pre-Employment Orientation package. 
Already in effect, this training has been provided to approximately 50 new employees to date. 
Follow-up training is ongoing through weekly treatment team meetings and scheduled workshops. 

The Developmental Therapy-Teaching Programs staff have contributed assistance with 
proposals, planning, and materials for these new projects. While Regional Associates have expressed 
satisfaction with the guidance they have received, they also stress the importance of ongoing 
education and mentorship even as they become more proficient with this complex model. 

Evaluation question Task 5 . Were all of the tasks and projected outcomes measures achieved 
as projected, on time and within budget? The evaluation plan included both qualitative and 
quantitative measures of progress toward achieving intended outcomes. Both types of measures 
contributed to identifying effective outreach activities and the settings/conditions optimal for 
achieving the greatest results. These analyses provided feedback to individual participants and 
project staff so that learning experiences could be redefined, reinforced, revised, and replicated. In 
addition feedback to participants informed them of their accomplishments and permitted project 
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staff and program administrators to examine the end result of model implementation in each setting. 
Long-term uses of the project outcomes support independent model replications by certified 
individuals far beyond the scope of this project. It was designed to insure that local programs were 
assisted in improving and expanding their services to troubled children and teens. Outcomes 
achieved: 

/ An expanded group of certified leadership individuals skilled in conducting 
supervisory/coordination activities to maintain program quality at sites where students with 
severe SEED receive services in acquiring greater social-emotional competence and 
responsible behavior. 

/ A group of certified Regional Associates able to increase the number of replications of the 
model. 

/ An expanded group of skilled direct service professionals (teachers, administrator, support 
personnel) prepared to implement the model with new staff and new groups of students each 
year, as well as demonstrate exemplary practices for other educators in special and regular 
education. 

/ An increased number of replications using up-to-date, proven practices shown to be 
effective. 

/ An expanded number of quality demonstration sites where others seeking information about 

the model can observe effective model practices in a variety of program settings (public 
schools, residential programs, day treatment, home programs and other community service 
settings). 

PROBLEMS ENCOUNTERED AND HOW THEY WERE SOLVED 



There were several unanticipated problems which influenced the direction of grant activities 
over this three-year period. These problems reflect issues and challenges both specific to this project 
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as well as those in the field of severe social-emotional-behavioral disabilities and how they impact 
on outreach assistance for model implementation. The challenges and how the project responded are 
described below by management task effected. 

Challenges in the Training Trainers Program and Project Response 

Early in the project, administrators expressed the need for the Training Trainers Program to accept 
more than one leadership participant at individual sites. Concerns were for effectiveness and 
sustainability over time. As with the familiar issue of re-training due to staff turnover, administrators 
judged the risk of losing the only on-site certified instructor too great. Also, many articulated the 
value of having a leadership team with advanced skills and knowledge about the model coordinating 
and supervising implementation activities. During training and beyond, these individuals could 
coordinate and maintain effectiveness by providing feedback, problem solving, supporting, and 
guiding direct service practitioners as they worked to implement the model with children who had 
severe social-emotional-behavioral problems. This DTT certified leadership team would also 
conduct introductory level training for new persoimel and provide support to existing staff as they 
continued to acquire advanced skills for model implementation. 

To address this request, the project staff adjusted the Training Trainers Program to accept 
up to four leadership personnel at selected participating sites. Project instructors, along with the site 
trainees, developed individual training plans specific to meet identified needs; however, group 
seminars, observations and tutorials were implemented when possible. To accommodate the 
additional training time needed, long-distance communication and instructional options to the 
implementation sites were pursued. A Training Trainers’ LIST-SERVE, teleconferencing, and 
frequent email, fax and phone consultation were utilized. Actualizing this effected the original 
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design for site-wide model implementation (see details of site development model replication 
problems in the section below). 

Challenges in Site Development for Model Replication and Project Response 
The outreach model of intermittent, in-depth training and follow-up at participating site visits for 
observations and debriefings with every individual team was found to be untenable with the dual 
role of project instructors to certify leadership personnel in DTT Regional Associate competencies 
and to train program staff. The solution was to carefully plan for specific needs at each program with 
the site administrators. This planning included identifying a limited number of teams who 
volunteered for a one or two year pilot effort to assess the goodness of fit between the model and 
the established program. Only two of the twenty sites were unable to continue implementation 
activities after initial training. 

Another problem in planning involved local concerns about additional paper work and time 
to be required of participants. Already over-loaded with paper work and record keeping, this 
question was raised at every site. A parallel concern was the question of "fit" between the model's 
assessment instrument for developing lEPs, Functional Behavioral Assessments, Behavioral 
Intervention Plans and the site's district requirements. These issues of balance between model 
requirements, limitations in project staff, overload of staff at local sites, and their expressed needs 
for inservice assistance were addressed during planning with administrators at each site. In the initial 
inservice training with participating teams, these issues were frequently revisited. Most, but not all 
of the sites, were able to blend model implementation requirements with local requirements. In each 
instance where this did not occur, local administrators and participating teams made the decision to 
include the model’s instruments for social-emotional-behavioral assessment as an add-on to local 
requirements for lEPs, FBAs and BIPs. 



Turnover of staff is an on-going problem throughout the field. We encountered numerous 
instances of absenteeism, staff resignations during the school year, and extended illnesses both 
physical and mental, causing shifts in job assignments and changes in teams participating in project 
activities for in-depth model implementation. Site administrators expressed their concern over this 
dilemma, which left them with new, inexperienced or untrained replacement staff throughout the 
year. This situation gave rise to a need for repeated introductory training sessions on the basics of 
model implementation, while other team members were ready for advanced skill development. To 
address this issue, RAs at several sites initiated tiered inservice training with several levels of 
training being provided simultaneously. Also, mentoring systems were employed where more 
experienced teachers were paired with incoming teachers to assist in building skills in DTT 
practices. 

Challenges in Trainers Network for On-going Outreach and Project Response 
This task rapidly expanded. The major challenges have been communication, consistent data 
collection and funding. The importance of providing timely, on-going support cannot be 
underestimated. The national network extends from coast-to-coast and its members have their own 
set of growing needs-consultation on project proposals, evaluation and feedback on new training 
materials, and problem solving training issues-to list a few. The majority of network members are 
employed full time in very demanding positions. The issues of consistent data collection are directly 
tied to their finite resources in staff, time and funds to balance expectations to provide exemplary 
programs and document effectiveness of these programs. In some cases, the evaluation procedures 
the project expected were extra as they were in addition to mandated instruments. 

In response to these concerns, project staff sought to develop systems to improve 
communication and reduce paperwork while maintaining accountability. Distance contact was 



enhanced through the implementation of the RA LIST SERV which enabled members to 
electronically contact project staff and each other. Satellite and teleconferences were held and were 
very successful. Members have requested that these continue quarterly. To support timely data 
collection, a computerized quarterly reporting form was developed and electronically sent to 
Regional Associates. Cover sheets for DTORF-Rs (child data) and DTRITS (staff data) were 
developed and were sent to each RA as a reminder at pre-designated times. Following these contacts, 
phone calls were utilized and often data information, was collected over the telephone. Project staff 
were also sent to sites to collect data. Funding remains a challenge. 



Challenges in Project Evaluation and Project Response 

This management objective presented the greatest problems for the project, as we originally 
anticipated conducting evaluation activities with the rigor of a research project. The evaluation 
design proposed originally was used, but problems inherent to gathering in field-based data 
presented obstacles which required modifications in several of the proposed evaluation activities. 
Because the evaluation plan had both formative and summative aspects, evaluation was a significant 
time-intensive, on-going project activity. It became necessary to shift position responsibilities 
among project staff when the collection and maintenance of accurate field records became 
increasingly demanding and time consuming. 

The most difficult aspect of the design to fulfill was the assurance of reliability and validity 
of the observational performance data collected on participating teams and the children they served. 
At every site. Regional Associates and project instructors reported the same types of difficulties: (a) 
immediate internal crisis or personnel needs drawing RA leadership trainee away from observations, 
tutorial feedback and/or seminar, (b) lack of substitutes/release time for participants during inservice 
visits by project instructors, (c) a key member of the team and/or a high number of children absent 
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during observation period, (d) a non-representative activity such as lunch or study hall, and/or (g) 
new staff. 

Collection of reliable and valid data on the progress of children served during the project 
presented a different set of problems. One of the core requirements for model implementation is the 
accurate use of the DTORF-R rating procedures by the participating teams as they rate the social- 
emotional-behavioral development of every child in their group. The project staff did not do these 
ratings; the RA participated in the ratings and was expected to review each team's completed ratings 
for accuracy. Project staff reviewed ratings as DTORF-R data was received. If discrepancies were 
evident, the instructor, the RA and the team met to revisit the process and ratings. This procedure 
required that the project instructor to have sufficient time when on site to observe each child in the 
program. 

The original evaluation plan specified collection of both baseline and intermittent DTORF-R 
measures on each child. Valid baselines were sometimes difficult to obtain from some teams because 
(a) they lacked a sufficient understanding of the instrument even though they had participated in the 
preliminary workshops (a core content requirement), (b) difficulties for project staff to obtain the 
basic demographic information needed (such as file access) to describe the sample population, (c) 
carelessly completed ratings, (e) untrained staff participating in the rating, and/or (d) incomplete 
ratings. Collection of valid ratings repeated throughout the school year to document progress was 
also difficult as children (a) moved away, (b) were newly enrolled, (c) transferred to other programs, 
and/or (d) were absent during the rating periods. 

To assure reliability and validity of the data and confidence in the accuracy of the findings 
for participating teams and children, it was necessary to accept smaller numbers in the samples. 
While this approach may have introduced bias into the sample selection process, samples which had 
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reliable data were used while those with incomplete or inaccurately collected data were excluded. 
The smaller samples are representative of the typical participants, children served, and sites. 

IMPLICATIONS FOR POLICY, PRACTICES, AND RESEARCH 
The educational problem of how to provide and sustain mentally healthy learning 
environments that promote positive social-emotional competence has become a national educational 
challenge in the 2T‘ century. About 4 million children and youth in the U.S. have mental health or 
behavioral problems. In schools and other settings, these problems can interfere with their own 
learning or the learning of others. Highly skilled and knowledgeable teachers who use positive, 
effective classroom practices are essential for all children. 



Recommendations for the Field 

The complexity of troubled young people demands an equally sophisticated, multidimensional 
approach with shared values and standards that transcend races and cultures. Providing for 
complexities involved in effective special education for this group of children and young people 
should be a central principle in policy and practice. Here are several recommendations that would 
follow from such a central principle: 

1. Program missions should be grounded in a conceptual foundation of how healthy 
personalities and social competence develop, and include learning, valuing, relating, 
behaving with responsible self-control, and basic thinking and problem-solving. 

2. Programs should be conducted with seamless components for mental health interventions, 
and include involvement with other major social institutions that shape children’s lives - 
families, childcare, law, government, recreation, and spiritual life. 



O 

ERIC 



54 



62 



3. Assessments should be based on procedures shown to be reliable and valid for identifying 
child's current assets in each of the areas addressed in the scope of the intervention program 
and criteria for child progress should be established with defined outcomes having practical 
and theoretical validity. 

4 . In planning a child ’ s intervention program, defined procedures should be used for gathering 
and analyzing past experiences to more fully understand the impact on a child’s current 
status. 

5 . Advanced skill training with demonstrated proficiencies in developmentally and emotionally 
appropriate practices, human relationships, and sustained practice of mission standards 
should be required for anyone working in this field — including professionals and 
paraprofessionals in special education, mental health, and general education. 

6. On-going inquiry into the presumed effectiveness of every practice with every student 
should be part of every program. 



Recommendations for Effective Outreach and Technical Assistance 

Project experiences, problems encountered, and feedback from Regional Associates and front-line 
practitioners over the past three years suggest numerous ways to assist individuals and programs at 
the local level in meeting the needs of this difficult-to-serve group. 

1 . Skilled local leadership. Though Regional Associates expressed time and opportunity 
concerns over their dual role of supervisors and trainers, direct service personnel stated that the 
availability of immediate support and feedback helped them attempt and improve their skills in 
model practices. Active involvement both during the instructor’s site visit and during the interim 
between visits seemed to inspire more confidence. The greatest benefits for model implementation 
accrue over time as Regional Associates with high levels of proficiency and knowledge about the 
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model reinforce this in daily interactions with staff and children, in treatment meetings and with 
targeted inservice training. Finally, assessment of child progress was more accurately completed at 
sites where there was an active leadership person in training. 

2. On-going site evaluations. Teams in intervention programs are not typically enamored of 
data collection processes, justifiably, as additional paper work and accuracy are necessary. However 
on-going evaluation of each child’s progress is essential if program quality is to be maintained. We 
observed that teams were able to modify their day-to-day practices with more precision at sites 
where Regional Associates systematized and coordinated child progress data collection and 
encouraged program alterations based on the new information. Thus, they adjusted their practices 
as children made progress. In contrast, at sites where assessments were not made a priority, program 
practices were not as readily changed as children changed. We found that considerable outreach 
effort needs to be put into helping local administrators and coordinators put basic evaluation 
procedures in place. When local staff and parents (a) see evaluation results in formats easy-to- 
understand and interpret at a glance, (b) receive supportive assistance in using the results in practical 
ways to improve classroom conditions, and (c) are assured that their own value is not threatened by 
the results, there appears to be greater commitment to being a part of ongoing program evaluation. 
We encouraged each site to work to accumulate a database to build their own normative expectations 
about child progress in that program. 

3 . Family involvement in intervention programs . Family involvement was initially low at the 
participating sites, reflecting similar widespread problems in the field. When Regional Associates 
placed a priority on involving parents in the DTORF-R rating, they reported some change in 
attitudes and practices. Feedback from several Regional Associates noted that, as parents 
participated with their child’s team in rating social-emotional-behavioral development, project 
participants and parents were increasingly more positive about each other and the child’s potential 
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for progress in the program. While such highly positive changes were not evident at all sites, we 
believe that by putting greater emphasis on parents as team members, outreach projects can 
contribute significantly to enhancing constructive family involvement for a child’s benefit. 



Recommendations for Outreach 

The degree of flexibility in current OSEP guidelines for conducting discretionary grant-funded 
projects is reasonable to outreach activities. We found the meetings in Washington beneficial in 
keeping up with current trends and new innovations — especially those that focused on our area of 
severe social-emotional-behavioral disabilities and technical problems of documenting intervention 
effects. We also found that contact with the larger national technical assistance projects were of help, 
especially those that came from allied fields involved with mental health or technological issues. Our 
grant officer was supportive and available at Director’s meetings and by phone and email. 

A great number of requests for on-site outreach assistance came from Regional Associates 
and direct service providers who wanted to see model practices in action. They expressed a need to 
observe model practices demonstrated effective with children who had challenging behaviors similar 
to the ones they experience daily. We endorse the idea that skill acquisition is easier when there are 
opportunities to observe and model effective practices. Whenever possible, project instructors 
identified staff in local programs that were demonstrating proficiency and success with model 
practices. We also made arrangements for a few Regional Associates and direct service providers 
to visit other programs out-of-state to see model practices. However, these opportunities were few 
because of difficulties obtaining release time, substitute teachers and funding. We experimented with 
satellite workshops, phone-conferencing and shared training opportunities to bring participants from 
other sites in contact with each other. These were always well received. The expanding technology 
systems available via satellite, video and electronic mediums are possible avenues to support contact 
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and observation opportunities; however, we found the cost of these services limited their use. 
Expansion of federal funding for outreach would allow for greater involvement between project 
participants and distance activities. 

With a network of certified Regional Associates providing outreach, expanding staff 
development programs at their local sites and in their respective regions, continued technical 
assistance is required particularly with time, additional job responsibilities and staff at varying 
effectiveness levels. In addition, with so many competing requirements, school- wide training blocks 
for staff development are difficult to schedule. Should funding be secured, a project is prepared 
which would enable collaboration with Regional Associates to develop four easily accessible, Web 
based instructional modules for independent, self-paced forms of learning. The content will be 
organized into a three-phase sequence for increasingly advanced skills and knowledge. This will 
allow for a coordinated flow of assistance to Regional Associates, provide content at an 
individualized pace and time, assure an understanding of model content and accelerate the 
implementation of model practices. 

In summary, this project has shown that extended on-site, in-depth, extended outreach 
assistance will result in improved program quality and skill acquisition by direct service providers, 
supervisors, coordinators, children, and their families. The lesson to be learned is that even more can 
be gained from these expenditures in the future if closer links are made available between an 
outreach project, local implementation programs, and high quality demonstration programs. 
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Regional Associates Network 



Appendix A. 

Developmental Therapy - Teaching Programs 
Regional Associates Network 





69 





70 



Appendix B. 

Minimum Requirements for a Regional Associate Instructor 
to Maintain Certification for 

Instruction in Developmental Therapy-Developmental Teaching 
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Appendix B. 

Minimum Requirements for a Regional Associate Instructor 
to Maintain Certification for 

Instruction in Developmental Therapy-Developmental Teaching 

Part 1; Training and Certifying Practitioners to Work with Troubled Children and Youth 

1 . 1 Instruct practitioners in the accurate use of the DTORF-R assessment instrument to assess 
students’ social-emotional-behavioral status, following rating procedures as outlined by 
the Developmental Therapy - Teaching Programs. 

1 .2 Instruct practitioners to select individual student’s program/treatment objectives based on 
the DTORF-R results, using these results to plan and conduct therapeutic programs that 
foster students’ social-emotional growth and responsible behavior. 

1 .3 Certify practitioners’ proficiency with the DTORF-R using standards established by the 
Developmental Therapy - Teaching Programs for reaching proficiency with three age 
groups: Children below age 6, children ages 6 to 12, and adolescents above age 12.* 

1 .4 Instruct practitioners to use the DTORF-R results as the foundation for selecting 
specified behavioral interventions (management strategies) that will be used with each 
student. 

1 .5 Instruct practitioners in basic theoretical content areas contained in the Developmental 
Therapy - Developmental Teaching textbook: Developmental stages of social-emotional- 
behavioral development, developmental anxieties, the existential crisis, decoding 
behavior, developmental values/motivations, social roles, social power, and group 
dynamics (the latter 3 topics for those in training to work with children above age 9). 

1.6 Instruct practitioners in team roles and skills needed for implementing Developmental 
Therapy - Teaching (see Chapter 7 in the Developmental Therapy - Developmental 
Teaching textbook). 

Part 2: Training and Certifying Practitioners in the Identified Teaching Skills Needed for 
Implementing Developmental Therapy - Teaching 

2. 1 Teach practitioners to use the Developmental Therapy Rating Inventory of Teacher Skills 
(DTRITS) for self-monitoring their own skills in demonstrating Developmental Therapy - 
Teaching practices. 

2.2 Certify practitioners’ proficiency with Developmental Therapy - Teaching practices 
using standards established by the Developmental Therapy - Teaching Programs for 
evaluating their performance on the DTRITS. * 

2.3 Instruct practitioners in ways to successfully involve families, general education teachers, 
and other community resources in each student’s program. 
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2.4 Instruct practitioners to develop an evaluation plan to monitor, document, and report on 
each student’s progress on the DTORF-R at repeated times during the school year. 

2.5 Certify those who meet the standards established by the Developmental Therapy - 
Teaching Programs (as designated by the asterisks) and any other additional standards 
established by the Developmental Therapy - Teaching Programs, using an approved 
version of the Developmental Therapy - Teaching Programs Certificate. 

Part 3: 

3.1 Participate in the network for on-going communication and support between the 
Developmental Therapy - Teaching Programs, certified National Instructors, certified 
Regional Associate Instructors, and the certified practitioners. 

3.2 Participate in a re-certification training sequence for certified instructors and practitioners 
every five years. 

3.3 Use the Developmental Therapy - Teaching logo on all relevant materials. 

3.4 Provide a minimum of one Developmental Therapy - Teaching presentation at local, 
regional and/or national conference a year. 

3.5 Provide the Developmental Therapy - Teaching Programs with copies of all training 
materials developed, with appropriately marked source and copyright information. 

3.6 Prepare an annual report for the Developmental Therapy - Teaching Programs including 
documentation of items marked with an asterisk (*) above. This report will be used for 
re-certification of Instructors every five years. 
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Appendix C. 

Workshops and Presentations 



Appendix C. 

Workshops and Presentations 
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* DT-TP National Trainer/Consultant to DT-TP 
** Presented feedback independently in workshop format 
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Appendix D. 

Focus Agendas for Teleconferences 
Focus Agenda, Conference #1 

November 25, 2002, 2:00 - 3:00 p.m. EST/ll:00-noon PST 

The integration of creative, purposeful activities designed to meet children’s needs for 
emotional/social and academic progress 

Greetings from Bonnie McCarty, chairing this telephone conference: 

In this hour let’s focus our conversation on experiences and observation we have had as we support 
staff in integrating DTT concepts and practices, particularly purposeful creative activities in their 
classroom or program environments. 

Let’s begin by taking a moment to introduce ourselves, identify the program we are working in, and 
describe our program and the staff we are training. 

It is helpful. to others if you will give your name as you contribute to a discussion. Then, at the end 
of the hour, sign off by name when you hang up. In that way we will know when everyone is off- 
line. 

We’ll divide the hour into three topics: 

TOPIC ONE: (about 20 minutes) LET ’ S HEAR ABOUT GENERAL EXPERIENCES YOU HAVE 
HAD SUPPORTING PRACTITIONERS WITH INTEGRATING CREATIVE ACTIVITIES. 

What have you done as trainers to try to get others to think about using creative activities throughout 
their instruction? 

How have you introduced this idea and what have peoples’ responses been? 

Have people identified content areas that are more/less conducive to this integration? 

TOPIC TWO: (about 20 minutes) LET’S DISCUSS THE KEY IDEA TO DTT— THAT IS THE 
PURPOSEFUL PLANNING BASED ON IDENTIFIED DTORF-R OBJECTIVES. 

What have you done to help people make the connection between identified need based on the 
DTORF-R objectives students are working on and the design of the activities? 

Have you noticed successes and/or problems with people in their efforts to make this connection? 

What techniques have you used to emphasize activities that encourage all aspects of social- 
emotional development, i.e. communication, socialization, as well as behavior and academics? 

TOPIC THREE: (about 20 minutes) LET’S TALK ABOUT HOW WE BUILD CONFIDENCE / 
SKILL / WILLINGNESS TO INTEGRATE DTT. 

Have you noticed any developmental processing in your trainees to this approach? 

Are there observable steps in trainees — ^what they need to begin and how they progress? 

Have the materials you’ve been provided supported your efforts? 

Have you developed materials yourself? 
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FINAL QUESTION: How can the Developmental Therapy - Teaching Programs at 
the University of Georgia continue to support you in your training efforts? 

Remember to mark your calendars for the next phone conference — Dec. 3, 2002, 2:00 - 3:00 p.m 
with Peg Wood: Successes and Stumbling Blocks in Training Others to Use Developmental 
Therapy-Teaching Practices. You will receive another e-mail about it and the focus for that 
conversation. In the meantime, let us hear from you if you Lave particular questions or topics you 
want to bring up at that time! 

Please sign off by name when you hang up. In that way we will know when everyone is off-line. 



Focus Agenda, Conference #2 

Dec. 3, 2002, 2:00 - 3:00 p.m. EST/ll:00-noon PST 

Successes and Stumbling Blocks in Training Others to Use Developmental 
Therapy-Teaching Practices 

Greetings from Peg Wood, chairing this telephone conference. 

In this hour let's focus our conversation on how we go about training others to use the practices and 
concepts of Developmental Therapy-Teaching. 

We'll begin with a "roll call", to introduce ourselves, identify the program we are working in, and 
describe our staff training responsibilities. 

The first phone conference with Bonnie McCarty was a rich sharing of experience and talents. To 
build on that, we will divide the hour into two topics: 

TOPIC 1. (about 30 minutes) LET'S HEAR FROM EACH OF YOU ABOUT YOUR 
APPROACH TO TRAINING STAFF: 

What are you trying to help your trainees learn? 

How do you go about selecting the people and content for your training? 

What strengths or skills do your trainees usually have before you begin training? 

What seems to be the most difficult thing for them to catch-on to? 

How do you deal with staff turnover and training new staff? 

How do you maintain quality practices of your trainees during a school year? 

TOPIC 2. (About 30 minutes) AS A TRAINER, HOW DO YOU PERSONALIZE YOUR OWN 
TEACHING STYLE TO SEE RESULTS IN STAFF PERFORMANCE? 

What techniques have you used with practitioners to emphasize activities that encourage all aspects 
of social-emotional development, i.e. communication, socialization, as well as behavior and 
academics? 

What do you do to get their attention and buy-in to what you are presenting? 

What skills of your own do you rely on for effective training of others? 

How do you know when your trainees are connecting with the content? 
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How do you handle mistakes trainees make in applying the content? 

Do you have to balance debriefing feedback with staff performance evaluations? 

What skills of your own are you trying to improve? 

FINAL QUESTION: How can the Developmental Therapy - Teaching Programs at the University 
of Georgia continue to support you in your training efforts? 

Again, it is helpful to others if you will give your name as you contribute to a discussion. Then, at 
the end of the hour, sign off by name when you hang up. In that way we will know when everyone 
is off-line. 

Also, remember to mark Thursday, December 12 on your calendar for the last phone conference, 
chaired by Dan Bums. You will receive another e-mail about it and the focus for that conversation. 
In the meantime, let us hear from you if you have particular questions or topics you want to bring 
up at that time! 



Focus Agenda, Conference #3 

Dec. 12, 2002, 2:00 - 3:00 p.m. EST/ll:00-noon PST 

The DTORF-R: Helping Teachers use the DTORF-R to create a therapeutic instructional 
environment — ^What’s worked?. 

Greetings from Dan Bums, chairing this telephone conference. 

In this hour let's focus our conversation on how we go about training others to assess students with 
the DTORF-R and use this information in their classroom programs. 

We'll begin with a "roll call", to introduce ourselves, identify the program we are working in, and 
describe our staff training responsibilities. 

The first two phone conferences with Bonnie McCarty and Peg Wood were a rich sharing of 
experience, talents, and ideas. To build on that, we will divide the hour into two topics - 
TEACHING THE INSTRUMENT and SUPPORTING THE UTILIZATION OF DTORF-R 
INFORMATION IN PROGRAM PLANNING AND CLASSROOM PRACTICES. 

It is helpful to others if you will give your name as you contribute to a discussion. 

TOPIC 1. (about 30 minutes) AS A TRAINER, LET'S HEAR FROM EACH OF YOU ABOUT 
YOUR EXPERIENCES WITH TRAINING STAFF in the DTORF-R. 

Who have you trained? 

How have the sessions gone? 

How do you know when your trainees are connecting with the content? 

What seems to be the quickest part for trainees to catch on to? 

What seems to be the most difficult part for them to catch-on to? 

Have the materials you’ve been provided supported your efforts? 

Have you developed materials yourself? 



TOPIC 2. (About 30 minutes) HOW DO YOU ASSIST TRAINEES IN UTILIZING A DTORF-R 
PROFILE (GROUP PROFILE) FOR CLASSROOM PLANNING AND PRACTICES? 

How have you seen your trainees utilize DTORF-R information? 

What seems to be their biggest successes? 

Are there some content areas in which it is easier to address DTORF-R objectives? 

Which areas are most difficult? 

What do you do to assist trainees to learn to focus on their students’ DTORF-R objectives? 

How do trainees incorporate this topic in their debriefings? 

FINAL QUESTION: How can the Developmental Therapy - Teaching Programs at the University 
of Georgia continue to support you in your training efforts? 

Also, we are interested in your thoughts on how these phone sessions have gone and your interest 
in continuing them. You will receive an on-line evaluation in early January for this. In the meantime, 
let us hear from you if you have particular questions! Sign off by name when you hang up. In that 
way we will know when everyone is off-line. 
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Appendix F. 

DTORF-R Qualitative Control 
AGE - STAGE Congruity 
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Appendix G. 

Evidence of Extended Training 



ng DT-DT in courses 



Subject: Using DT-DT in courses 
Date: Sat, 22 Feb 2003 09:14:58 EST 
From: RussUtz@aol.com 
To: cquirk@arches.uga.edu 

Connie, 

I currently am using DT for teaching my course Models of Classroom Discipline which is a required graduate course 
in the Severe ED annotation. Students in this course are teaching or want to teach in classes or schools for children 
with more severe ed problems. Ages of their kids include the entire range. My enrollment is approximately 25 per 
year-offered every spring. This semester I am using the DT book as my text along with Charles' Building Classroom 
Discipline . The Wood and Long Life Space Crisis Intervention is on reserve for them to use. We begin with DT 
approach and they are required to do a DTORF and DT/RITS. At the end of the course they write a paper which 
outlines their approach to discipline. If you would like any of the assignments, I could send them to you. 

The other way that I will be using DT is in my early childhood special education coursework. In the fall, I will be 
teaching a graduate course which I wrote based on DT. It is called "Managing the Behavior of Young Children." I 
have the course proposal but I am just beginning to generate ideas. I usually have about 10 or so students in my 
classes. Some of the Gateway folks are my graduate students will be in my course. Pam Rouse at Gateway has 
offered that I can hold some of my classes at their site so that the students can see how to set up Stage 1-3 
classrooms. This is about as far as I am with the planning right now. If you need more info, I can respond to 
questions. 

Needless to say, DT-DT pervades every course I teach and all of my supervision. I don't use the DT/RITS on a 
regular basis because the department has certain required forms. I will be using it with my early childhood graduate 
students in the future when the course is being offered. 

I have also submitted a proposal for a blended undergraduate program in early childhood and early childhood special 
education. This is under review by the college and eventually the SUNY Regents. When approved, it will use the DT 
approach as its basis. Needless to say-1 need all of the teaching materials you can supply for me. 

Enough. Judy. 
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Teaching Teams - Intensive Training 



Educators and Therapists involved in treatment of emotionally disturbed children may qualify for 
extended training in Developmental Therapy - Teaching. This training to include; 

• Individualized On-Site Training 

• Observation & Consultation 

• Instruction in Assessment 

• Mentoring in Implementation 

A 10 month program to achieve mastery of skills. 

Training will consist of four on-going components: 

1. Group Seminars, offsite. 

2. DTORF-R Assessment and Implementation T raining , on-site 

3. Observation/Consultation using the DTRITS, on site. 

4. Reading assignments and tests to help participants self-evaluate mastery of knowledge 
basis of program. 



Group Seminars 

Introductory Session: 14 hours, September 8“’ and 9“’ 2002 
Six 3 hour training seminars throughout the school year. 

Participants will be assigned reading to precede each seminar. A test will be included at the closing 
of each seminar so teams can self-evaluate their progress in mastering the knowledge component of 
the program. 

DTORF-R Assessments and Implementation 

Trainer will co-lead DTORF-R assessments on at least 2 children in their program 3 times 
during school year approximately 3 months apart. 

Trainer will provide consultation with Teaching Team for planning activities and opportunities 
to teach goals identified in these assessments. 

Observation and Consultation: 

Trainer will observe program a minimum of 4 times during the school year. 

Feedback sessions with the treatment/teaching team will follow; 

The DT/RITS (Developmental Therapy Rating Inventory of Teacher Skills) will be used at the 
first and last observation to evaluate and train teaching team in skills necessary to support children’s 
social-emotional development. Teams will use the DT/RITS to self evaluate and work toward mastery 
of teaching skills. Results of DT/RITS evaluation will be confidential shared only with trainer and 
treatment team. 



Foot note: We are anticipating 2-5 teams from Port Townsend and Chimicum School Districts. 
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Training Time Line 

September 8***, 9*** Introduction to Developmental Therapy - Teaching by National Trainers 
from University of Georgia. 14 Hours. 

Sept 23"* - 30“* Two DTORF-R Assessment meetings with treatment team, caregivers, and 



Oct1*‘-18“’ 


other providers co-led by Trainer. 

Follow-up session to plan activities and methods to teach identified social- 
emotional and behavioral goals identified in DTORF sessions. 

Instruction in creating a Group DTORF-R will be included in this session. 

90 minute Observation by Trainer using the DT/RITS 

Same day Consultation session with treatment team regarding 

observations. 


October 


3 hour Training Seminar: Administration and Scoring of the DTORF-R 
Discussion of September DTORF-R Sessions. 

Prerequisite Reading, User Manuai DTORF-R 


November 


3 hour Training Seminar; Stages and Anxieties 

Trainees will review the 5 developmental stages and compare program 

needs for children in each stage. 

Prerequisite Reading: pp. 177 -311 in Deveioomentai Therapy- 
Develoomentai Teachina text bv Mary Wood, Karen Davis, Faye Swindle, and 
Connie Quirk. 



Nov.18‘*’-Dec.13**’ 



January 


60 minute Observation and follow-up Consultation by Trainer 

3 hour Training Seminar: The Learning Process, 

How the Emotional Memory Bank Works, Steps in Program Planning, 
Schedules, Steps in the Activity Planning Process, General Program 
Guidelines 

Prerequisite Reading: Chapter 4 in DT-T text. pp. 81 - 105 


Jan. 10‘*’-31*‘ 


Two DTORF-R assessment meetings, led by Treatment Team leaders 
with assistance from trainer. Follow-up planning session with trainer. 


February 


3 hour Training Seminar: Keys to Decoding Behavior 
Session will review developmental anxieties, defense mechanisms, the 
process of adjustment and other psycho-social issues that influence 
children’s behavior. 

Prerequisite Reading: Chapter Two, pp 29 - 51 in DT-T text. And assigned 
reprints. 


Feb. 3"* - 27**’ 


60 minute Observation and follow-up Consultation session with Trainer 


March 


3 hour Training Seminar: Positive Behavior Management 
Steps in designing a Positive Behavior management Plan, adult roles and 
behaviors needed to assist children in increasing personal responsibility. 
Prerequisite Reading: Chapters 5 and 5 in DT-T text, pp. 107- 149 
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Aprii/May Two DTORF-R assessment meetings, led by Treatment Team leaders 

with assistance from trainer. Follow-up planning session with trainer. 

May 6*" - 31st 90 minute Observation by Trainer using the DT/RITS with follow-up 
team 

Consultation session. 

June Two Hour Wrap-up Training session. Reviewing Progress and 

Discussion of future training needs. Competency test to evaluate 
knowledge of DT-T model. (Ufe Space Cri^s Intervention Training 
recommended fOr School Age Treatment Teams during Summer 03) 



Group Training: 31 Hours 
DTORF-R Assessment training: 9 hours 
DTORF treatment planning: 6 hours 
Observation and Consultation: 9 hours 

Total Training : 55 hours 
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A TRAINING/COACHING MODEL FOR IMPROVING ADULT/CHILD 
INTERACTIONS IN CHILD CARE SETTINGS 

This proposal for use of Mental Health Division 2001 Supplemental Federal Block Grant 
Funds focuses on improving the skills of child care providers as they work with children 
who have challenging behaviors because of social, emotional, and/or mental health concerns. 
The project will provide training on Developmental Therapy-Developmental Teaching for 
child care providers who work with children who have challenging behaviors. 

This model for working with children was developed by Dr. Mary Wood at the University of 
Georgia and is used extensively in Georgia as well as other states and countries (England 
and Germany.) Developmental Therapy-Developmental Teaching (DT-T) is a psycho- 
educational curriculum for social and emotional growth organized around the sequences of 
normal developmental milestones that all children experience. It is a ‘growth’ model rather 
than a ‘deficit’ model which focuses on assisting children to cope effectively with the 
stresses of their lives. Positive effects adults can have on children when they adjust 
strategies to the social-emotional needs of children are emphasized in the curriculum and 
management practices. Priority is placed on assisting children to acquire the specific skills 
for effective interpersonal behavior, social knowledge, social problem solving, managing 
feelings, and behaving responsibly. 

In the past four years the Mental Health Division has invested both time and funding to train 
trainer/coaches (Developmental Therapy Regional Associates [RAs]) in the model with the 
intent of using them to continue to provide training to teachers, mental health workers, social 
workers, and child care providers. This proposal would use these consultants as trainers and 
coaches in child care settings. In addition, the funding would allow for travel so that staff 
from the Georgia project could be involved in the actual training of child care staff. 

TARGET POPULATION 

This proposal targets child care providers in Thurston, Mason, and Lewis Counties. The 
emphasis will be on training available to all providers and long-term, specialized coaching 
sessions to a maximum of eight providers on request. 

Eligibility will include both center based and in-home licensed providers. Requests for 
training and coaching must come through center or in-home directors, as participating staff 
will require administrative support to fully participate in the project. 

VISION, GOALS, OBJECTIVES 

An ongoing issue among child care providers is difficult and challenging behaviors of 
children who are in the foster care system, who are in need of therapeutic assistance, whose 
behaviors stem from lack of appropriate nurturing in their family setting, and children who 
are being raised in stereotypical generational poverty settings. These are the children who, 

o 
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without intervention, have a high likelihood of school failure and later entrance into the 
mental health and/or criminal systems. 

Many children who most need a nurturing approach to care are the very children who are 
removed (or ‘kicked out’) of child care because their inappropriate behaviors do not allow 
them to participate in the expected ways. They may be disruptive to activities and 
aggressive toward other children and adults. They do not always respond to the behavioral 
techniques that are typically taught in classes and workshops on dealing with difficult 
behaviors and, often, unskilled providers do not have the skills or understanding of 
development to create the environment that will help these children learn more appropriate 
behaviors. 

Using the Developmental Therapy-Developmental Teaching model, it is the vision of this 
project to assist providers to create emotionally safe and nurturing places for children who 
have social/emotional concerns while parents work. 

Project goals, objectives, and activities are: 

♦ Providers will increase knowledge and skills in working with children who have 
challenging behaviors. 

♦ Provide information and on-going training for child care providers on understanding 
developmental needs and adult responses which may create challenging behaviors 
including; 

♦ Series of four three evening trainings on Developmental Therapy-Teaching 
focused on child care providers; 

♦ Classroom/program observation and coaching to selected providers; 

♦ Ongoing training and support for childcare administrators. 

♦ Providers will develop skills in reflecting and problem solving to deal with ongoing 
behavior challenges 

♦ Provide ongoing on-site skill building for child care providers through use of 
coaches; 

♦ Support administrators in use of coaching and problem-solving techniques. 

This project will use Washington Regional Associates (RAs) fi'om the Developmental 
Therapy-Teaching Project and DT-T staff fi’om the Georgia Project to provide four three 
evening training sessions covering the components and skills needed to implement DT-T. 

Up to fifty child care staff will be able to participate in the evening training sessions. 

Four Washington Regional Associates will provide four follow up observation and coaching 
sessions for two programs each. In this way, eight programs will be served by coaching 
during the year. Each program will receive four coaching visits to be timed between training 
sessions. 





G - 6 



3 

INTERAGENCY/CROSS SYSTEM WORK 

Multiple agencies and providers have committed to support and collaboration in this project 
including: 

♦ Olympia School District Early Childhood Programs 

♦ Olympia Child Care Center 

♦ Child Care Action Council of Thurston, Mason, and Lewis Counties 

♦ Thurston County Health District (Building Child Care Capacity for Children with Special 
Needs Through Public Health Partnerships) 

♦ ESD U3 

♦ Thurston, Mason, and Lewis County Infant Toddler Early Intervention Programs 

♦ Thurston County Parent to Parent 

♦ Family Support Center 

♦ Behavioral Health Resources 

These agencies will work collaboratively with the project to provide: 

♦ Access to the child care community; 

♦ Access to training and coaching staff; 

♦ Ongoing support for coaches; 

♦ Assistance with training space and miscellaneous training needs; 

♦ Assistance with using child care scholarship funding to offset training costs (e.g., 
Washington STARS Scholarships, etc.); 

♦ Fiscal, space, coordination, and clerical support; 

♦ Information for families; 

♦ Purchase of DT-T books for participating providers. 

TIMELINES 



ACTIVITY 


PROJECTED START 


PROJECTED 

COMPLETION 


CONTRACT WITH 
TRAINERS/RAS 


OCTOBER 1, 2001 


OCTOBER 31, 2001 


PROVIDE 4 TRAININGS 
OF THREE EVENINGS 
EACH 


OCTOBER, DECEMBER, 
FEBRUARY, APRIL 


AUGUST 31, 2002 


PROVIDE ON SITE 
COACHING FOR UP TO 
EIGHT CENTERS 


NOVEMBER, JANUARY, 
MARCH, MAY 


AUGUST 31, 2002 


EVALUATE PROGRESS 


MONTHLY/END OF 
YEAR 


AUGUST 31, 2002 
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EVALUATION PLAN 

This project will be evaluated using a variety of both qualitative and quantitative 
methodologies 



QUANTITATIVE 

METHODOLOGIES 


QUALITATIVE METHODOLOGIES 


♦ Number of providers training 

♦ Number of programs involved in 
follow-up coaching 

♦ Number administrators involved in 
training and support 

♦ Likert scale ratings of training 
sessions 


♦ Staff progress on the Developmental 
Teaching Teacher Rating Inventory of 
Therapeutic Skills (DTTRITS.) 

♦ Participant Perception of change 
interviews 

♦ Continuous Improvement (Cl) and 
written reports from training and 
coaching sessions 



CONSUMER AND FAMILY INVOLVEMENT IN PROPOSAL 



This proposal and project was developed by the Child Care Committee of the Thurston 
County Infant Toddler Early Intervention Program (ITEEP.) This committee comprises child 
care providers, public health staff, Child Care Action Staff, ITEIP staff, ESD 1 1 3 staff and 
the Thurston County Parent to Parent Program. This committee met two times to discuss 
and develop this proposal. 

BUDGET 



♦ Developmental Therapy trainers @ 2000 per 

trip X 4 RAs time for training and coaching $8000 

♦ 3 RAs X 4 visits X 2 programs at $150 per day $3600 

♦ Coordination/clerical staff (ESD) $5000 

♦ Staff and RA travel $1300 

♦ Materials, Supplies/contracts $300 

♦ Indirect $1800 

TOTAL Grant Costs $20000 



Other costs/fees (to be covered by fees and partnerships with community collaborators): 



♦ Rental space for workshops $800 

♦ Copying for workshops $ 1 000 

♦ Food for workshops $1000 

♦ Books for participants $5600 

o 
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♦ Additional fees for RA coaches $3200 

TOTAL other costs $11600 

FEES 

To offset other costs, nominal fees will be charged to child care providers for the training 
sessions. Coaching sessions will be at no cost. Fees will be approximately $50 per 
workshop per person. This would make a total cost for four workshops for one staff member 
$150. This cost will be offset through scholarships available through the Child Care 
Resource and Referral programs (CCR&R), and the State Training Registry System 
(STARS.) 

College credit, clock hours, and STARS credit would be available for participants. 





Children who have challenging behaviors have difficulty in child care settings. Often 
these are the children who are asked to leave their child care and, eventually, run out of 
options in the community. Too often they are the children whose mothers are in job 
training working hard to escape from welfare. Losing child care can mean losing the 
hope of ever having a life out of poverty. 

Olympia, Washington’s “Training/Coaching Model for Improving Adult/Child 
interactions in Child Care Settings” was designed to alleviate this problem by training 
child care providers to use Developmental Therapy-Developmental Teaching strategies to 
understand children’s behavior from a developmental perspective; use stage appropriate 
adult behaviors to respond to children’s needs; and create activities that respond 
therapeutically to children’s needs. 

Funded through the Department of Social and Health Services Division of Mental Health, 
the project is operated through Educational Service District # 1 13 and serves child care 
programs in Thurston and Mason Counties. Thirty child care providers from ten 
programs are involved in attending four Saturday workshops between January and 
September, 2002. In between sessions participants have homework relevant to their 
session content such as readings, observation, practice DTORFs, and trying new 
techniques. 

A unique feature of the project is that seven of the participating programs have learning 
coaches or mentors who visit them at least one time between the workshops. Agendas for 
coaching may include observation of children and adults; assistance in transferring 
training to staff members who are not involved in the workshops; assistance in planning 
program changes to better meet the needs of the children and families; and a variety of 
other things designed to meet each program’s specific needs. 

The workshop curriculum is a version of the two and one half day DT-T training tweaked 
for the special needs of programs and staff who are with children twelve hours a day. Dr. 
Faye Swindle and Washington Regional Associates work on the curriculum, lead the 
workshops, and provide the, coaching. RAs involved are Kelley Simmons Jones, Scotty 
Jones, Suzan Wambold, and Mary Perkins who also coordinates the project. Mary Samo 
is the project officer for the Division of Mental Health. 
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Training Impact Report 
June 2001-August 2002 
RA: Kim Henderson 

Site: Presbyterian Children’s Services, Lexington Kentucky 
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3-4 hours 
each 
specific 
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sent to front 
line 


1 session 
1 hour 
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Basic Overview 




Basic Overview 


Recommendations 
on interventions 
for students 
having behavioral 
incidents 


Deescalation, 
developmental 
anxieties and 
assessing clients 


Basic Overview 


Overview 
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orientation 




New employee 
Orientation 


Agency Risk 
Management 
Committee 
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Team Training 
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Therapy 
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team 

meeting 
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2001 
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To: Dr. Constance Quirk, Developmental Therapy-Teaching Programs 

From: Suzan Wambold, School Counselor, MA, LMHC, NCC, Federal Way School 
District 

Date: March 17, 2003 

RE: Training Impact Report 

1. 1999- Trained district school counselors and psychologists in an "Overview of 
the Developmental Therapy-Teaching" model. There were 8-10 participants and 
the training ran for 4 sessions of 2.5 hours each. 

2. 2000- Trained district counselors and physical therapists in "Using the DTORF- 
R." , There were 8-10 participants and the training ran 4 sessions of 2.5 hours 
each. 

There are 400-600 children at each school and one counselor per school. (Some 
participants were not able to attend all sessions) Students' age ranged between 5- 
12 years old. 

Feedback was good on the trainings. Counselors began using the DTORF-R and 
called periodically to consult on students that they had completed the DTORF-R. 

3. Since 1998, 1 have used Developmental Therapy-Teaching in my work as a school 
counselor. Our building holds 670-575 students each year. I have completed 
approximately 2-5 DTORF-R's on students as a way to "teach" teachers and 
parents about appropriate expectations of these children. 

4. In 2000, 1 was asked to conduct a training of my staff on the Developmental 
Therapy-Teaching model. I gave a brief overview and continued training with 
individual teachers as they requested more information. We have approximately 
26 teachers and several teacher assistants. 

5. From 1998-2001 our building had a SBD program. I worked with the teacher 
and the teacher's assistant, sharing Developmental Therapy-Teaching and 
completing DTORF-R's on each child. There were 24 students in this program 
over the three years. There was also a new teacher each year. The classroom 
was consisted of intermediate students between 9-12 years old. 

6. I participated in a training of pre-school staff in Vancouver, WA on March 3'"'^ 

& 4^*^ 1999. 1 don't remember how many people participated in this training. 
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7. I worked with Faye and Sarah on the summer institute in June 2000 (I believe). 
I couldn't find the registration form for the exact year. This was a training 
institute for teachers, counselors and other school staff for school age kids. I 
did a breakout session on "How to use the DTORF-R in a school setting." There 
were approximately 15-20 people attending that session. I had two individuals 
from that session who used the DTORF-R on children in their buildings and 
wanted to consult with me re: their use of the DTORF-R and then on how to 
discuss with teachers and parents when they completed the process. I can’t 
find where I put my notes on these conversations. The feedback they gave was 
that this process assisted them in setting realistic expectations for their 
students and helping the parents to understand their children's developmental 
level of functioning. 

8. In 2001-2002, 1 participated in training in Olympia, WA with preschool and day 
care programs. The training ran a course of 6 months 4 daylong training 
sessions and I was available for consultations with staff in-between. I received 
calls from some of the staff from the YMCA programs where I supported their 
implementation of some of the model in 3 different centers. I also conducted 
site visits between training dates. 

My experience with the YMCA programs was positive. I would say that there were 
20+ children at each site I worked with and 2-3 other staff persons. This training 
and consultation continued through the summer and I did one consultation at the 
summer camp site. 

My experiences with the regional associate process and these trainings have been a 
tremendous addition to my practice as a school counselor and consultant. I have a 
framework that allows me to be specific in discussing the needs and abilities of the 
students with teachers and parents. Last year I was asked by a principal in another 
building to provide individual Developmental Therapy-Teaching training on the 
DTORF-R for her counselor. The counselor was excited and apprehensive in 
attempting the process and called several times to consult on her work with a 
student. This type of consultation also occurred with counselors and an OT/PT who 
took the DTORF-R class. 




G - i7i5 



Training Impact Report 
June 2002 - September 2003 
RA: Jeaimle Morris and Whitney Braddock 
Site: CPP Baxley and CRP Jesup 



03/17/03 MON 12:06 FAX 912 427 9164 



CEDAR'-VOOD 



@022 



Evaluation 

1 


Yes - Sent 


Yes -Sent 


Yes - Sent 


Yes -Sent 


Yes -Sent 


Yes ' Sent 


Age 

Range of 
Chil<fren 
Impacted 


5 to 19 


B 

\Tk 


5tol9 


5 to 19 


5 to 19 


5 to 19 


Number 

of 

Children 
1 impacted 


S 


3 


a 


O 

in 


m 

PN 


in 

rs 


Type of 
Program 


Power Point 
and 

participation 


Power PdrA 
and 

Raiticipation 


PowerPoint 

and 

Participation 


Power Point 

and 

Participation 


Power Poftrt 1 
and 

Participation 


Poiwer Point 
and 

Participation 


Number of 
Participants 


in 

V— 1 


IN 


IN 

V— I 


\n 

ri 


O 

fM 


rH 


« 9 


a 

o 

cn 


3.5 hours 


3.5 hours 


2.5 hours 


2.5 hours 


C 

g 

JZ 

in 

IN 


Content 


• stage 
Milestones 

• Stage 
Characteristics 

• Stage Goals 

• Adult Roles 


|l|| 

lliSl 


c 

1 

8 

• 


Therapy 

Behavior 

Management 


Strategies 


Title 


In Search of 
the Jeweb cf 
Normal 
Deveiopmert 


Calming the 
Stormy Seas: 


Developmental ' 
Therapy 
Behavior 


u 

B .S' 


Date 


July 25,2002 


August 7, 2002 


August 27 , 2002 


September 23, 2002 


October 4, 2002 


October 16, 2002 



00 

I 

o 




116 



3EST COPY AVAILABLE 



May 10 -11. 2001 
Millinocket, Maine 




The Goal is Social-Emotional Development: 

Set the Stage for Success 
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'Help for rroiiblcd or rroiihliiuj children 



Developmental Therapy - Teaching Programs 



IDEAS' 

"•"Work 

^ 

U.S. Office of Special 
KJucation Pro|;ram» 



For more information, please visit our website: www.uga.edu/dttp 



THE WORKSHOP WILL INCLUDE: 

Introduction to the Developmental Therapy-Developmental Teaching Approach 

^ How does your classroom program reflect what you believe about troubled children 
and youth? 

^ How can Development Therapy - Developmental Teaching help you rate and guide 
your students' progress? 

^ How do you change your teaching strategies to meet individual needs? 

Put the Curriculum into Practice: Looking ahead! 

^ How can you apply the Development Therapy - Developmental Teaching model in 
your own program? 

^ Are you ready to use what you know as ingredients to implement a successful 
program? 

^ How can adult teamwork help troubled children resolve problems they have with 
adult authority? 

Creating Learning Environments: There’s more than meets the eye! 

^ How well do you read the messages embedded in students’ behavior? 

^ How do you determine what makes materials and activities motivating? 

^ What guidelines do you use to select meaningful, successful management 

strategies? 
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Constance Quirk is Director 
ofthe Developmental Therapy 
- Teaching F^rograms. She has 
extensive experience using 
Developmental Therapy - 
Teaching in the classroom as 
well as supervising and 
training adults in the 
Developmental Therapy - 
Teaching approach as a 
National Instructor. 

Charleen Cain, a Music 
Therapist and Special 

Educator, has over twenty 
years of teaching experience. 
She is a certified 

Developmental Therapy - 
Teaching Regional Associate 
Instructor and currently 

serves as the Developmental 
Therapy - Teaching 

Consultant for MSAD #40 in 
Waldoboro, Maine. 



Art, Music and Storytelling; Tools for Guidance 
of Young Children 

A Developmental Therapy- Teaching Perspective 

Course Developers: K. J. S. and S. J./Regional Associates 
Class dates: TBA; June - August, 2003 
Course Prerequisites: None 

Welcome to Art, Music & Storytelling: Tools for Guidance of Young Children. These 
pages will give you some information about what to expect from this course. Please feel 
free to ask questions or schedule conference time with me. You can reach me outside of 
class by calling (706) 369 - 5689. 

This class will include lecture and discussion time and opportunities to try out a number 
of creative activities. Skill/talent is not a pre-requisite and you will not be graded on your 
artistic prowess. The activities we will do are designed for creativity and success. 

Please let me know if you need any accommodations in order to be successful; if so 
we'll make a plan together to meet the need. 

Course Description: 

The intent of this course is to sensitize and help child care professionals to acquire the 
knowledge and skills to teach children utilizing the mediums of art, music and storytelling 
with young children. The course is intended to train the participant to observe and 
engage children from a developmental frame of reference, to understand the messages 
in a child's behavior, and to become acquainted with specific teaching techniques which 
respond to children's needs and stages of development. The use of creative methods 
such as art, music and storytelling will be emphasized. This course, using the 
foundations of a Developmental Therapy-Teaching perspective, will instruct the child 
care professional by providing translations of theoretical constructs into educational and 
practical application. This model emphasizes the normal processes in every child and 
works systematically to strengthen these aspects as a means to enhance social and 
emotional growth and development. 

Instructional Methods: 



This course will include lecture/presentation, discussions, small and large group work, 
cooperative-problem solving activities, video discussion, reading and reflective writing 
exercises. Participants will be expected to attend and contribute to the learning 
community by full and active participation. Reading assignments are considered 
important in providing background, introductory and supplemental information and 
resources. Students are expected to read assignments to provide them with a 
foundation for class activities and discussions. A variety of child guidance and 
educational materials, including videos, will be utilized to augment class content. 

Course Objectives: 

Participants will gain an understanding of the theoretical foundations of Developmental 
Therapy -Teaching, social-emotional behavioral development as a strength based 
approach to teaching children; 

Participants will become familiar with the normal, sequential development of children, 
socially and emotionally, and gain an understanding of how to positively impact 
children's healthy growth and development through various methods and thematic, 
creative activities (lesson plans); 



• Participants will practice applying knowledge of developmental stage characteristics to 
the elements of learning environments such as materials, activities, adult roles and 
positive management strategies. 

• Participants will produce developmentally appropriate activities (lesson plans/curriculum) 
for creative art, music and literary experiences; 

• Participants will demonstrate the use of a variety of curriculum materials for creative art, 
music and literary activities; 

• Participants will develop and compile a resource book demonstrating the ability to 
implement developmentally appropriate creative experiences with young children. 

Course Requirements: 

• Participate in all hours of class time. 

• Be punctual and prepared for class. 

• Read all assigned readings according to schedule. 

• Bring assigned readings to class and discussion question and/or materials to class. 

• Complete and submit assignments on or before the due date. 

• Communicate immediately with the instructor if you require any accommodations. 

Homework and Grading: 

(A rough outline of the homework is listed here. Additional details will be given in class) 

Due Class 2: Complete weekly assigned reading and develop one question for the 

class. Come prepared to class with this question written out on a 3 x 5 
index card. This question is your ticket into class! 

Complete the Praise & Reflection Assignment documenting observations. 

Complete journal entry with reflections and questions and finalize your 
Mission Statement and record in journal; bring journal to class. 

Due Class 3: Complete weekly assigned reading and develop one question for the 

class. Come prepared to class with this question written out on a 3 x 5 
index card. This question is your ticket into class! 

Complete a draft form of a literary review and analysis of four (4) 
children’s’ books, select from the list provided , complete draft forms 
provided and bring to class. 

Complete written reflections in journal related to the reading, class 
discussion or questions related to what you have learned so far. 

(Extra credit or assigned?) Create one teacher-made storybook for the age/stage children 

you currently work with or may work with in the future. Bring to 
class prepared to share with the group and turn in to instructor. 

Due Class 4: Complete weekly assigned reading and develop one question for 

the class. Come prepared to class with this question written out 
on a 3 X 5 index card. This question is your ticket into class! 

Complete the final literary review and analysis of four (4) children’s’ 
books; bring final copies on three-hole punched paper, complete one 
form per book and provide copies for each member of the class. Begin 
selection of book/theme for activity project. 
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Complete the Positive Behavior Management Assignment documenting 
observations and questions and turn in assignment. 

Complete written reflections in journal related to the reading, class 
discussion or questions related to what you have learned so far; bring 
journal to class. 

Due Class 5: There is no assigned reading this week - Bring any question 

you like on 3 x 5 card related to course. 

Using the previously selected and reviewed children’s books 
begin developing (3) complete activity/lesson plans and show all 
work; include theme, objectives, activity steps, draft lesson plan 
and draft prototype. Bring to class for small group work and 
feedback. Bring draft copies for partner(s). 

Complete written reflections in journal related to the reading, class 
discussion or questions related to what you have learned so far. 



Due Class 6: Visit the Website for DTT : www.uaa.edu/dttp 

Complete 1 page Reflection paper & your revised final mission statement 
as your ticket into class. The Reflection paper should include how this 
course impacted you and the work you do with children. Indicate your 
expected grade for the class with reasoning. 

Bring complete Lesson plan activities for final review and begin 
presentations. Bring copies on three-hole punched paper of your (3) 
lesson/activity plans, one (1) for each classmate 

Presentations; 10-15 minutes to present one (1) lesson plan to the class 
with prototypes and provide lesson plan samples for classmates. Be 
prepared to answer questions about the developmental focus and 
objectives of the activity. The sample plans are compiled into each 
students Resource Book. 



Participation points are based on: being present for the entire class session, getting to 
class on time and returning promptly from breaks, taking part in class discussions, 
respecting the ground rules of the class, having reading assignments finished. 

Course requirements must be completed. There will be no partial CEU credits issued 
without a written medical reason or other serious family emergency. Missing 
assignments will be deducted from total points. Late assignments will NOT be accepted. 
Assignments must be prepared using a word processor or typed with the exception of 
journal entries which may be legibly hand written. 



Instructor reserves the right to modify the course schedule or homework based upon the 
instructional needs of the group. 



Point Distribution: 




Participation/Class Discussion/ Attendance 


- 100 


Joumal/Reflections 


- 50 


Observation Assignments 


-100 


Literary Review 


- 50 


Activity/Lesson Plans 


-150 


Presentation 


- 50 


Total Possible Points 


-500 



Grading Scale; 
Pass/Fail 

Pass = >349 points 
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